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THEORY OF FLUID AND CRYSTALLIZED 


INTELLIGENCE: 
A CRITICAL EXPERIMENT" 


RAYMOND B. CATTELL s 
University of Illinois 


The theory of fluid and crystallized intelligence propounded 20 years ago 
by the author has since accumulated support. However, the crucial is- 
sue of whether 1 or 2 general factors subtend intellectual performances 
has lacked an experiment adequately designed for accurate, determinate, 
simple-structure rotation at the 2nd order. By factoring culturally em- 
>» bedded with culture-fair intelligence measures on a background of pure 
personality primaries (N = 277 7th and Sth grade boys and girls), it is 
shown that 2 general factors indeed exist. A review, with some mathe- 
matical formulations, is given of the theory's implications for the nature- 
nurture ratio, brain injury, standard deviation of the IQ, growth curves, 
the concept of a relational difficulty hierarchy, test standardization, and 


the relative validities of traditional and culture-fair intelligence tests. 


Present TRENDS IN INTELLIGENCE 
CONCEPTS 


Since Spearman’s demonstration of 
the general ability factor (g) first put 
intelligence testing in the framework of 
scientific research, the field has experi- 
enced three major theoretical develop- 
ments, which, however, have not hitherto 
been interrelated. 

1. Thurstone’s (1938) proof that any 
comprehensive array of ability measures 
will factor uniquely into a set of simple- 
structure, oblique, primary abilities, 
from which g can be obtained as a 
second-order factor, more uniquely de- 
terminable than by the first-order 
approach. ` 

2. The notion, most frequently asso- 
ciated with the name of Piaget (1947) 


_ tthe research reported herein was per- 
formed pursuant to a contract with the United 
States Office of Education, Department of 
Health, Education, and Welfare. We are also 
indebted to D. W. Dunnan, and the school 
teachers of Springfield, Illinois, and to C. C- 
Newman, and the school teachers of Paxton, 
Mois, 


but widely surmised, and stated very 
clearly by Ferguson (1956), for example 
(see also the review by Hunt, 1961), 
that the formal structure of abilities is 
partly developmentally determined by 
what might be called “generalized solu- 
tion instruments” (i.e., habits the acqui- 
sition of which becomes a key, opening 
the way to rapid advance in some gen- 
eral area of cognitive problem solving). 
These we shall briefly call “aids.” 

3. The theory of “fluid and crystal- 
lized general abilities,” which states that 
with more refined analytical methods the 
general ability factor now measured by 
intelligence tests will be found to be not 
one factor but zwo. In spite of marked 
cooperativeness of loading pattern (Cat- 
tell, 1952), which makes them difficult 
to separate, they have properties differ- 
ing in vital ways for educational and 
clinical prediction. 

This article puts forward entirely new 
evidence specifically on the theory of 
fluid and crystallized g factors, but inte- 
grates all three of the above an a 
implications for practical testing 
terms of culture-fair intelligence tests. 


THEORY OF FLUID AND CRYSTALLIZED 
GENERAL ABILITY 


Although the theory of fluid and crys- 
tallized general ability was first stated 
20 years ago (Cattell, 1941, 1943), 
and since developed more precisely 
(Cattell, 1950, pp. 477-491; Cattell, 
1957a, pp. 871-879; Cattell, 1957b), the 
momentum of custom amorg intelligence 
testers, and the absence of sufficiently 
sustained research on the theory, have 
hitherto denied to practical test con- 
struction and use the advantages in un- 
derstanding that might be expected to 
acrue from such dual measurement. The 
main problem in research advance is 
one of organization, since, as the fol- 
lowing summary of the theory will 
show, coordination is necessary among 
specialists and practitioners in several 
different fields. Parts of the following 
theory have been stressed by certain 
investigators, e.g., in Ferguson’s (1956) 
use of “ability” and “learning set,” 
Hebb’s (1942) notion of A and B com- 
ponents in ability, Newland’s? (1962) 
use of process and Product, and Hayes’ 

(1962) notion of “experience-producing- 
drives” (though the last joins cognitive 
and dynamic components here kept sep- 
arate). But the necessary experimental 
conditions for constructive conclusions 
are possible only if the total theory is 
kept in focus, as is happily the case in, 
for example, the recent work of Horn 
(unpublished), The interrelated aspects 


? In communicating to nonpsychologist teach- 
ers, for example, the Particular aspect of the 
fluid and crystallized ability theory expressed 
in Newland’s “process” and “product” proves 
to be readily conveyed by these terms. In any 
more precise and comprehensive context the 
terms mislead, however, for the capacity to 
learn is not only a function of the process 
(fluid ability) but often of the Product, as 
well as of personality and motivation, Particu- 
larly when aids have been acquired, the rate 
of learning is a function not only of fluid 
ability but of the crystallized products of for- 
mer application of process. 
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of the theory may be briefly stated as 
follows: 


1. That among the primary abilities 
in the area semantically designated “in- 
telligence” in our culture (and which, as 
Guilford points out, is not totally gen- 
eral to cognitive performance) there is 
not one “general ability” second-order 
fattor, as in the Spearman-Thurstone 


resolution (Cattell, 1943), but more. k 
Two of these are highly cooperative 
(Cattell, 1952) in the sense that they ‘ 


agree in loading positivery must of the 
general ability primaries and have 
largely zero loadings outside the intelli- 
gence field. Being cooperative they are 
very difficult to separate, and most pre- 
vious ability factorings have been satis « \ 
fied to recognize the joint factor as onc 
factor. This conglomerate has been made‘ 
the basis of IQ measurement and has 
been called “general intelligence.” Tech- 
nical reasons for this confusion are dis- 
cussed in the section “Implications for 
Experimental Checks on the Theory.” 

2. The two factors, which will be 
called fluid (f) and crystallized (c) 
general ability, g, and So, and indexed? 
as U.I. (T) 1 and UI. (T) 2, have 
different properties, as follows: 


a. Crystallized ability loads more 
highly those cognitive performances in 
which skilled judgment habits have 
eee 

*In the Universal Index 
posed elsewhere (Cattell, 1957c; Cattell & 
Warburton, 1963), to preserve factor identi- 
fication during changing explanatory devel- 
opment, U.I. (T) 1 was assigned to general 
ability and U.I. (T) 2 to flexibility of closure, 
in French’s (1951) series. However, as pointed | 
out elsewhere (Cattell, 1957a, p. 830), there is 
ence that flexibility of closure i 
Personality Factor UI: (T) 19, 
n ability when ability tests only 
ccordingly it preserves the his- 
tance of order in the index much 
better if the UI, (T) 2 niche—flexibility going 
to ULL. (T) 19~is now allocated to crystallized 


ae ability, and flexibility removed to UL. 


(U.L.) system pro- 


outcropping i 
are used. Ai 
torical impor 


> 
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become crystallized (whence its name) 
as the result of earlier learning appli- 
cation of some prior, more funda- 
mental general ability to these fields. 
Thurstone’s Verbal and Numerical 
primaries, or achievement in geogra- 
phy or history, would be examples of 
such products. Fluid general ability, 
on the other hand, shows more in tests 
requiring adaptation to new situations, 
where crystallized skills are of no par- 
ticular advantage. 

b. Before, biological maturity (15- 
20 years of age) individual differences 
in the difference of g; and g. will re- 
flect mainly differences in cultural op- 
portunity and interest. Among adults 
these discrepancies will reflect also 
differences in age, since the gap be- 
tween ge and gr will tend to increase 
with experience and the time decay 
of gr. Although the speed of an intel- 
lectual performance is not a function 
of U.I. 1 and U.I. 2 alone, (for ex- 
ample, U.I. 22, Cortertia, is a power- 
ful personality contributor; Cattell, 
1957a), performances at speed, in any 
cognitive field, will load gr more than 
8e, while tests without time limit (un- 
less they are absolutely new and adap- 
tive), such as Thorndike called power 
tests, will have relatively large load- 
ings of ge. 

c. Fluid and crystallized abilities 
will differ on their age trend plots for 
the general population, gr reaching an 
early maximum at 14-15 years, while 
g. increases to 18, to 28, or beyond, 
depending on the cultural learning 
period for the given subculture. 
Thereafter, whereas gr will decline 
from about age 22 continuously to 
old age, ge will show a later and lesser 
drop. In all these comments on ge, it 
must be understood that we are talk- 
ing about the general factor in a broad 
array of crystallized abilities, not any 
Single crystallized ability. 


Qe. 
aay en F o”ep + retim Fermin) [1] 


d. The standard deviation of the 
IQ calculated “classically” from 
mental ages, will be about 12-16 
points for ge and 24-25 points for gr 
(Cattell, 1937, ,1955, 1957b). The 
latter will be rfore constant and bio- 
logically determined, whereas the 
former will hinge on culture habits. 
For example, classroom systems which 
slow the bright and press the dull will 
reduce the possible absolute individ- 
ual difference in ge at any age level, 
an@ ‘therefore, ge standard deviation 
of IQ, when annual increment is con- 
stant. Culture may similarly influence 
the sigma on ge in that a powerful 
education, with larger annual mean 
increments and, therefore, larger age 
performance sigma, will tend to re- 
duce IQ sigma. Parenthetically, since 
traditional intelligence tests are a 
mixture of ge and gy, the standard 
deviation of the IQ on such tests will 
be a function as follows: 


Fray FO” F Wet ayFecaytind 


where p subscripts mean across people 
at one age, and a subscripts mean 
across age (years), taken as the vari- 
ance of the means when 1 year sam- 
ples are included across an agreed 
number of yearly age groups. As 
orp) and ogg) can be assumed to be 
biologically given, the IQ sigma on a 
traditional, culture-contaminated in- 
telligence test will in general become 
smaller (over school years only) 
where schools produce a large age 
increment in scholarship and where 
opportunity is not highly adapted to 
native ability differences, 1-¢., when 
Te is small. 

e For any same-age group the 
nature-nurture variance ratio will = 
much higher for gr than Be er EN 
hypothesis that gr is directly physio 
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logically determined whereas g. is a 
product of environmentally varying, 
experientially determined investments 
of ge. At present the only available, 
and still scant evidence, reached with 
the new multiple %ùbstract variance 
analysis method (Cattell, Stice, & 
Kristy, 1957) for culture-fair tests 
(which we shall show are largely 
g: measures), does point to higher 
inheritance* for gr. However, al- 
though it is our hypothesis that gr 
is biologically and physiologicaliy de- 
termined, as a function of total corti- 
cal cell count, this does not mean that 
one would expect anything like com- 
plete hereditary determination. For en- 
vironment includes gestation period in- 
fluences and later physical trauma and 
physiological change, all affecting gr. 
f. The reversible, day-to-day or 
month-to-month fluctuations in level 
will be different in gẹ and Ze, the 
former varying only with general 
physiological efficiency (Pribram, 
1960) and the latter less with physi- 
ology and more with recent exercise 
and interest. 
g. The effect of general brain dam- 
age (eg. arteriosclerotic) will be 
similar in both but more pronounced 


* This conclusion require: 
nical discussion for which 
Previous studies, such a 
(1954b) and Burks 


S some special tech- 
we have little space. 
s those of Blewett 
(1928), Freeman, Eysenck, 
and others used twin methods in which the 
environmental diff 


V n erence range (that between 
twins) is smaller than in the total family of 


sibs, as in our studies. Since the actual ratios 
we obtained with Culture Fair Tests are close 
to the mean of those they obtained with tradi- 
tional tests, despite our environmental range 
being larger, the Culture Fair Tests can be 
concluded to have lower environmental deter- 


Baai ; 122:5 
mination. Our ratios were T= = 
1754 (0% ge 


netic contribution for twins, and Bi- 90% 


for the genetic component in between-family 
variance in gr (Cattell et al., 1957, p. 154). 


in ge. The effect of local brain dam- 
age will be always to lower gr in pro- 
portion to the magnitude of the dam- 
age, but the effect on the ge score will 
only be through the localized ability 
changes, e.g., verbal aphasia (Lans- 
dell, 1962). Consequently, if the ge 
level happens to be estimated from a 
set of primaries which do not involve 
‘the particular area, as a representa- 
tive, in the standard array of sampled 
areas in a traditional intelligence test, 
no significant fall in ge IQ will neces- 
sarily be detected foliowhg local 
injury. 

h. The implication in Part a above, 
that crystallized ability will be a gen- 
eral factor, i.e., covering a substantial 
total and variety of ability measures, 
needs to be examined. For such a 
factor to arise it is necessary that 
people (a) compete in, i.e., be inter- 
ested and active over, the same series 
of experiential areas; and (b) experi- 
ence difference degrees of learning 
opportunity (to acquire skills) simul- 
taneously over all these areas. Evi- 
dence for the capacity of common in- 
struction and experience to generate 
such group or general factors comes 
from the pioneer researches of Anas- 
tasi (1936) and of Woodrow (1938); 
and later work by Greene (1953), 
Fleishman (1954), and others. Only 
when the common variance of experi- 
ence is considerable would we expect 
the magnitude (mean variance con- 
tribution over a standard sample of 
variables) of ge factor to exceed that 
of gr. 

Since the present ge levels of a set 
of people are simple growth-plus- 
accident functions of their gr levels 
obtaining a few years earlier, and 
since their Present g. levels are only 
a somewhat more complex function of 
g: levels over preceding years (see 
Equation 3), one would theoretically 
expect gr and ge to be substantially 


= 


b 
> 


W 
h 
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correlated. The conditions favorable 
to most substantial correlation prevail 
‘in subjects at school age with respect 
to ge factor measured over school sub- 
jects. In adult life, though school sub- 
jects will continue to correlate by 
“remnant correlations” (see below), a 
more valid measure of ge will be made 
by weighting a much wider range of 
performances, though any one is likely 
to be less loaded than were school 
subjects. The use of culture-fair tests, 
to meysureg;, becomes, under these 
adult conditions especially, the more 
reliable, valid, and intelligible intelli- 
gence measure. 

i. The rate of learning in any par- 
ticular area will be a function, as far 
as cognitive components only are con- 
cerned, not only of gr, but also of ge, 
and the level of the specific ability 
factor in that area. In so far as ge 
and the specific are concerned, we are 
thus saying that learning begets learn- 
ing capacity. Even so, the effect of ge 
as a general factor should prove to be 
small relative to ge in proportion as 
the learning is in a completely new 
area, And in old areas the non-gr-pre- 
dicted variance is more likely to de- 
pend upon crystallized group factors 
than the general factor, namely, those 
associated with what we have called 
aids. The demonstration of such ac- 
tion in learning increments, however, 
involves complex and refined statisti- 
cal treatment, as discussed by Hum- 
phreys (1959), Lord (1956), Tucker 
(1959), Woodrow (1939), and others. 


IMPLICATIONS FOR EXPERIMENTAL 
CHECKS ON THE THEORY 


The original theory of fluid and crys- 
tallized general ability has just been 
briefly recapitulated in the form of nine 
Propositions integrating quite diverse 
fields of psychological observation, and 
indicating a possible array of tangible 


experimental research checks. However, 
there are further implications which can- 
not be stated concentratedly in the nine 
propositions and, which require freer dis- 
cussion, before the need for certain fea- 
tures in our own experimental design 
can be clear. 

A first major implication is that the 
form of fluid ability—as a pattern of 
expressions and loadings—is due to an 
influence present and operative at the 
time of the experiment, whereas crystal- 
lized ability has a form determined by, 
and representing, history. Further, one 
is biologically, the other culturally deter- 
mined, Our earlier analogy for ge (Cat- 
tell, 1943) of the shape of a dead coral 
formation, representing the properties 
and accidental history of once living 
coral organisms, and Newland’s (1962) 
recent use of “process” and “product” 
(or Guttman’s “analysis” and “achieve- 
ment”) for ge and ge, bring out this 
meaning figuratively, in simple meta- 
phors, but not quite as precisely or com- 
pletely as the real scientific model needs 
to do. 

In behavioral terms, the theory of gr 
is that it is “a capacity to perceive rela- 
tions and educe correlates” in Spear- 
man’s (1932) original sense. Further 
the theory postulates that relations, be- 
ginning with those between sensory ele- 
ments, can be arranged objectively in a 
hierarchy® of increasing abstraction. and 


5 The present writer’s definition of intelli- 


gence proceeds to developments of Spearman's 
relational theory which should be distinguished 
from those for which Spearman would be 
responsible. It assumes that the hierarchical 
organization of relationships among relation- 
ships will begin with sensory fundamentals. 
The special sense areas will therefore form 
subsets, in the sense of mathematical set the- 
ory, and in a psychological sense, in larger 
sets. From this one might be inclined to con- 
clude that the most complex relations must 
necessarily lie in the Cartesian space involving 
all six sensory sets. This may be, but at least 
for the ordinary ranges of intelligence, suffi- 
cient complexity can be reached in the hier- 
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complexity, and that the level of gr of 
an individual at a given time is defined 
by the position in the hierarchy at which 
his insight fails, as shown by the onset 
of chance response be?.avior. It is a task 
for logicians (Braine, Y959), ecologists, 
and machine-simulation specialists to 
develop bases for this hierarchy; but our 
hypothesis would be that it will be found 
to rest on sensory area fundaments, and 
therefore, require for its genesis intact 
sensory neurological structure, as stated 
in Footnote 5. Meanwhile psychologists 
can delineate a rough hierarchy by 
trial-and-error item construction, or- 
dered by enlightened  difficulty-level 
analysis (extremity-vector analysis; 
Cattell, 1957, p. 360) experiments. 
Most attempts, operationally, to 
measure intelligence, even when it has 
been conceived as some sort of constitu- 
tional, fluid-ability, relation-eduction ca- 
pacity, have been made, however, 
through first measuring crystallized 
ability (ie., on fundaments and even 
relations upon which strong cultural 
training has already occurred). The new 
movement which began with studying 
relation-education in perceptual tests 
(Cattell, 1931, 1940; El Koussy, 1938; 
Fortes, 1932; Line, 1931; Penrose & 
Raven, 1936) apparently supports the 
theory, however, that quite complex in- 
telligence-demanding relations can be 
successfully set up in entirely new 
(and therefore perceptual, not memory- 
stored) material. Both experience and 
psychological reasoning in this area of 


archy within the relations arising from one 
sensory area, to reach the limen of failure of 
insight. This happens because there is a very 
large number of further subsets among which 
complex relations can hold, even within one 
sensory area. The successful use of Culture 
Fair Tests (involving largely spatial funda- 
ments) but transcending merely spatial rela- 
tions and ability, offers some proof of a 
sufficiently high relational complexity being 
attainable upon a limited (two sense) sensory 
foundation. 


endeavor lead to the general conclusion, 
however, that to place individuals in 
their proper rank order on gr it is nec- 
essary that the test fundament mate- 
rial should be either, (a) equally over- 
learnt by all, or (b) equally new to 
all (and therefore “perceptual” in the 
sense used in this particular field). 
Anything in between will contaminate 
the variance with experiential variance. 
The sensory area, eg., whether an 
analogies test is visual or by sound, 
seems unimportant. Hower; the ap- 
proach through a—equally overlearnt— 
is risky unless certain conditions are 
watched, and even though it ranks per- 
sons correctly, it gives no correct account 
of absolute level. Moreover, there is 
always the risk that individuals highly 
familiar with and trained in a field will 
know by rote the correct answers to rela- 
tional decisions into which they do not 
have, and have never had, any insight. 
For example, many people can respond 
that Einstein’s famous formula is e= 
mc*, not e=mc*, 

With these introductions to the gen- 
eral theoretical position we are ready to 
bring it to precise formulation, and to 
ask what the implications are for a 
crucial factor analytic experiment. At 
this level of precision it can no longer be 
assumed, at least in the ordinary cir- 
cumstances of experimental testing of an 
intellectual performance, that perform- 
ance level is going to be determined only 
by fluid and crystallized general ability. 
The specification equation must put 
these hypothesized two general abilities 
in the full context of specific abilities and 


temperamental and dynamic traits, as 
follows: 


Pi=SaF + 8y2P2+SinF y+ 
SuTo+siTitsFs [2] 


where F, and F, are gr and ge, respec- 
tively (as in the U.I. factor index); 
the Subscripts T, I. and J represent 
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temperament, interest (dynamic, moti- 
vation), and local area (specific) ability 
factors, respectively, and Fy represents 
a factor of strength of immediate mem- 
ory (for if, as in senility, the capacity to 
hold the material is deficient the ana- 
lytical capacities cannot act upon it). 

Actually these latter, in a fully ex- 
panded formula, would each be several 
factors, but that expansion is unneces- 
sary for our present statement of essen- 
tals. If, moreover, the performance (p;) 
is madeya..b*zhly intellectual one, and 
there is good, uniform, experimental mo- 
tivation, and sheer speed is not so im- 
portant that it brings in temperament 
factors, the analysis of the variance in 
P; can be restricted largely to the three 
Cognitive factors. 

To understand better what would be 
the theoretically expected outcome of a 
factor analysis of purely cognitive vari- 
ables (i.e., of “intellectual” performance 
measured under such conditions) let us, 
however, pry more closely into the na- 
ture of F.. This is our specification 
equation notation for ge which, accord- 
ing to Propositions e and i, should itself 
be resolvable historically into other fac- 
tors. In fact, any variable likely to be 
highly loaded on ge might, by special 
factor analysis directed to splitting F2, 
be expected to yield factors consistent 
with the Equation 3. This equation 
States that a crystallized ability perform- 
ance (pje) is a function of previous time 
(T) and interest (I) invested in the 
application of fluid ability; memory, 
and specific, problem solving aids. 
Pic= Wyr (Te+ Tes) Wit (le +1e5) 

[SnFie+SimF ae t+SjaF ac] +C [3] 
where: 

Te represents the time given earlier 

(e) to applying one’s abilities in 
a whole field of intellectual per- 
formances—i.e., to Pje Pry and 


the numerous other performances 
covered by F»; 

Tea is time specifically given only to 
Pies 

I, represents,the mean strength of 
interest i learning at that earlier 
time which, like T, is assumed 
common to several pje'S—e.g., 
those in school work; 

Iş is intérest specific to pje only; 

Fie is the level of fluid general ability 

_ over this carlier (not the pres- 

ent) learning period; 

Fyre is a memory capacity factor, also 
at its earlier level at that time; 

Fae is an aid, i.e., a discovered “in- 
strument for problem solving” 
mentioned earlier which oper- 
ates as a group factor over some 
area less wide than the general 
ability factors; 

C; is a statement of the change, an 
increment or deterioration by 


6 An aid is a term for the generalizable habit, 
discussed by Piaget (1947), Hunt (1961), 
Hayes (1962), Forgus (1955), Ferguson (1956), 
and others which opens up faster learning in 
a whole region, e.g. the infant’s grasping the 
possibilities of babble, the kindergartener’s dis- 
covery that doing to others as one would like 
to have done to oneself is an avenue to social 
goodwill, the junior high school student’s reali- 
zation that a triangle drawn on the board 
means not that particular triangle but a class 
of triangles, or that letters in algebra can 
stand for numbers, and so on. Such a piece 
of mental equipment stands in the class of 
achievement-attainment measures, as the use 
of Fa is intended to remind us. In the last re- 
sort, it is itself a product of Fi, Fx, etc, and 
belongs to that subclass of attainments which 
have the special property of aiding further 
attainment. As such it has an independence 
of these other terms and a characteristic field 
of operation, probably as a group factor like a 
Thurstone Primary Ability. In view of the 
length of time which Piaget and his followers 
have been discussing such action it is surpris- 
ing that there are still no multivariate experi- 
mental studies demonstrating their existence, 
and their nature and position among abilities 
generally; but they seem a reasonable specu- 


lation. 


“forgetting” since the original 
learning experience, due to time 
and changing interests, retroac- 
tive inhibitions, etc. (In the 
scholarship aroa one may think 
of the effect upon a foreign 
language area of neglect for a 
decade.) 


The s’s are the usual situational in- 
dices showing by weights specific to the 
time, interest, ability, etc., how much 
intelligence, memory, etc., contrihvte to 
performance, Pje The w’s are weights 
similarly given to number of repetitions 
(time of exercise) and strength of in- 
terest, e.g., Wjr is the rate at which in- 
creased time expenditure brings increase 
in Pje score. 

Two statements in this formula need 
especial comment: (a) Whereas in a 
present performance the specification 
equation for the factor analytic model 
adds factors of ability and interest to 
estimate the performance, we have here 
multiplied ability, memory, etc., by inter- 
est and by the time, recognizing thereby 
a different quality in them from addi- 
tive influences within the organism. 
Neither the rather hollow science of 
learning theory (still helpless where 
human higher abilities are concerned) 
nor the degree of precision of factor 
analysis (Tucker, 1959), permit deci- 
sion yet as to whether an additive or 
product model is better. But the prod- 
uct formulation is consistent with our 
formulations of motivation in the dy- 
namic calculus, elsewhere (Cattell, 
1957a) and is contingently adopted for 
these accumulative learning effects. (b) 
The T and I terms as indicated by their 
appearance outside the bracket, are not 
given separate values for the g,, memory 
factor and aid factors, though in an ex- 
panded formulation they might be given 
different weights. By the nature of the 
learning situation intelligence, memory, 
etc., would normally operate together so 
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they are gathered within the brackets 
with T and I outside. (The TI, if one 
wishes, is an integration of interest over 
time.) The introduction of the memory 
term (Fx) recognizes, as pointed out 
earlier, that a subject’s correct judg- 
ment, even on a test item of a highly 
intellectual kind, may depend on good- 
ness of rote memory, operating over the 
course of exposure to an intellectual edu- 
cation. For example, a correct decision in 
geometry may depend on remembering 
the formula for the area >f_a circle, or 
solving a crossword puzzle on good rote 
memory for Greek. As Cohen (1957) 
shows, the variance in intelligence per- 
formances from this memory component 
becomes large in older adults. 

Now our problem is to ask to what 
kind of a factor structure the theoretical, 
psychological formulation in Equation 3 
would be expected to lead. Should we 
expect distinct factors for T and I? The 
answer seems to be that although very 
specially planned and exceptionally exe- 
cuted factor analyses might express a 
product relation like T,I.F}, as an addi- 
tion of three factors, the normal preci- 
sion and choice of variables would yield 
a single general factor loading most 
highly the variables which have simul- 
taneously shared high interest, much 
time and much involvement of fluid 
ability. However, because they are mul- 
tiplied by the same T,I, the intelligence, 
memory, and aid factors would tend to 
be cooperative (Cattell, 1952) (i.e. 
loading the same variables). And if the 
variance in TeIe were great, we should 
expect a powerful second-order factor 
among them defined by T,I,. Thus there 
are really two possible definitions of the 
crystallized general ability factor: (a) 
As the first-order factor TeleFic, repre- 
senting the past areas of investment of 
fluid ability, and (b) as the second- 
order factor—strictly a general achieve- 
ment factor—corresponding to the in- 
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vestment of TIe in fluid ability expres- 
sion, memory, and various aids and spe- 
cial primary abilities. 

The situation is further complicated 
by the fact that skills not only increase 
but decay, and a common history of 
change or decay after the pattern has 
been reached as in the first part of Equa- 
tion 3 could also lead to a common fac- 
tor structure. This, with some over- 
condensation, we have represented by 
the term C; in the latter part of Equa- 
tion 3. “iS. example, if C; is a time 
function and our sample is scattered 
from 30 to 60 years of age, a general 
factor would tend to appear over all 
school subjects due to their all being 
forgotten to the same degree, as a func- 
tion of the time lapse. Such considera- 
tions have been grossly overlooked in 
traditional adult intelligence tests, as 
well as the fact that a new general crys- 
tallized ability factor, distinct from the 
scholastic one, is likely to arise through 
common learning by the application TeIe 
to whatever common areas of gr use 
exist for adults in our culture. Here 
only culture-fair, but not traditional, 
intelligence tests seem to recognize that 
in the majority of our population which 
Proceeds to “nonverbal” occupations 
(e.g., garage mechanics, farmers, etc.) a 
substantial decay of the attained crys- 
tallized ability levels in vocabulary and 
similar areas supervenes (Burt, 1955). 
Further, the normal adult intense invest- 
ment of skills in relatively narrow occu- 
pations will tend to make the appear- 
ance of a second “adult” crystallized 
ability factor, superseding the school 
curriculum crystallized general ability 
factor, a relatively poor substitute, of 
lower variance and poorer predictive 
Power. 

In summary, one must face the com- 
Dlication that the crystallized general 
ability factor is for various reasons Pro- 
tean. Strictly the term crystallized in- 


telligence (Symbol ge) should be re- 
stricted to the first of the two factors 
mentioned three paragraphs above, 
namely, to the Expression T.[.Fi. The 
second-order factsr covering Tele[Fie+ 
Fyte+ Fac] is in any sense of the word a 
general achievement factor, though it 
must be confessed that a substantial part 
of traditional, intelligence test scores de- 
rive from this source. Both of these 
factors are at the mercy of culture, and 
even before one encounters the difficulty 
of cross-cultural comparisons thereon, 
one gets entangled in the shift which 
occurs in them between the schooling 
age and the adult activity age. The Pro- 
tean character is thus at best reducible 
to four concepts, corresponding to four 
crystallized general ability factor 
patterns. 

1. School age crystallized intelligence 
(Zes)—common to gr expressions pow- 
ered by time and interest within the 
culturally set framework of the school 
curriculum. 

2. School age crystallized achieve- 
ment (aes)—a second-order factor across 
intelligence, memory, special ability 
areas, etc., corresponding purely to the 
effect of common time, interest, memory, 
and curriculum. It will differ markedly 
from ges in being predictive of achieve- 
ments (e.g., athletics, foreign languages, 
and rote areas of school learning) in 
which gr has never had any appreczable 
importance or role. 

3. Adult activity crystallized intelli- 
gence (fca)—Tepresenting whatever 
skills develop strictly from fluid intelli- 
gence being applied in whatever activity 
areas receive common time and interest 
from adults, i.e., TalaFia- 

4. Adult activity crystallized achieve- 
ment (aca)—representing whatever gen- 
eral factor is produced in adult achieve- 
ments through their common expendi- 
tures of time and interest. Except in 
mixed samples from different cultures 


10 Raymonp B. Cattery 


this would be a very tenuous factor of 
little practical predictive use. 

Only in the case of Concept 1 would 
we expect the correlation of fluid and 
crystallized intelligen*e factors to be 
really substantial, and the term intelli- 
gence is best eschewed completely for 
Concepts 2 and 4. Also the terms school 
practised? and “non-schpol-practised” 
abilities are misleading for ge and gr, 
for the first would describe both Con- 
cepts 1 and 2 and the second could be 
either Concepts 3 or 4, or gs. Any com- 
bination from decay influences is omitted 
from this reduction to four general fac- 
tor concepts. 


DESIGN OF THE EXPERIMENT IN 
RELATION TO EXPECTATIONS 


Testing the theory of fluid and crys- 
tallized intelligence requires not one ex- 
periment but a comprehensive organiza- 
tion of experiments. Yet one which 
needs to be performed before all others, 
as crucial to further work, is a factor 
analysis to check whether one factor or 
two runs through most intellectual per- 
formances. 

Technically, two questions need care 
in planning such a factor analytic experi- 
ment: 

1. Are we going to aim at abstracting 
T.I-Fie as a single factor or at splitting 
it? Theoretically it is not beyond the 
power of fine factor analysis to split a 
presently operating whole into the com- 
ponents which historically produced it. 
A product relation would be approxi- 
mated by additive factors as the plas- 
mode studied by Bargmann (1955), 
Cattell and Dickman (1962), Cattell 
and Sullivan (1962), and Thurstone 
(1947) sufficiently demonstrate. But in 
the present case Te, Ie, and Fie would 
be cooperative, because by the necessary 
choice of tests for intelligence they would 
be variables also on which common T, 
and I, have been expended. Besides 


there is much to suggest that product 
relations are often revealed by coopera- 
tive factor patterns. Consequently, since 
cooperative factors are hard to rotate 
correctly, it would seem best at this 
stage not to attempt such finesse but to 
accept variables sufficient to reveal crys- 
tallized intelligence as a “factor in 
being,” if it so exists. When such deeper 
analysis is eventually undertaken it 
would be well to keep in mind that I, 
might split again into a number of per- 
sonality and dynamic factbrs Ëg., super 
ego strength, emotional stability) affect- 
ing the investment of fluid intelligence in 
crystallized intelligence skills. Essen- 
tially this has recently been powerfully 
argued by Hayes (1962). Decay factors 
will also need consideration? 

2. Provisions must be made for defi- 
nition by rotation of factors possibly 
general to every cognitive test employed. 
One reason why the present theory, 
rather than the Spearman-Thurstone- 
Thomson theory of a single general in- 
telligence factor, has not hitherto re- 
ceived due and serious consideration is 
that most workers in the cognitive field 
have included only cognitive tests and 
thus rendered quite impossible any reve- 
lation of a distinctly rotatable second 


TA summary of the main influences now 
posited in any performance in the area se- 
mantically designated intelligence might be 
convenient at this final step: (a) a fluid 
general intelligence factor; (b) a crystallized 
general intelligence factor; (c) one or morc 
crystallized auxiliaries, corresponding to time 
and application acting with sheer capacities 
to memorize at the former among time (e.g. 
knowledge of vocabulary as distinct from nice 
judgment of meaning among familiar basic 
English words) ; (d) factors corresponding to 
any general patterns of change or decay since 
learning ; (e) existing personality and dynamic 
(motivation) factors helping application to an 
intellectual test, 

Here b, c, and d have structure in virtue of 
history, while a and to some extent e are struc- 


tures due to present organismic functional 
unities, 


peu 
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general factor. The procedures of Burt 
(1955) and Vernon (1950) for example, 
neither permit unique determination of 
the alleged general intelligence entity nor 
separation of a possible second general 
factor. 

The technical failure in factor analysis 
here, by which investigators have failed 
to see the wood for the trees, is only 
a special case of ignoring a general 
principle in scientific method—namely, 
the figure-ground principle, according to 
which, įf we wish to define X adequately 
we must introduce data which is not X. 
In this case to rotate with any approach 
to precision a factor expected to be gen- 
eral to all abilities one must include a 
wide framework of nonability factors 
(not merely variables) as hyperplane 
stuff (Cattell, 1952). Indeed, in spite 
of the immense importance of the intelli- 
gence concept to education, the second- 
order general ability factors appear never 
to have been so rotated, in any research 
discoverable by the writer, to a compre- 
hensively determined simple structure 
position.® 

In the present study we planned to 
reach the second-order analysis with 
only nine ability measures—a bare but 
sufficient minimum for testing the main 
cognitive hypotheses—but with 13 non- 
ability measures. The latter were chosen 
(a) to outnumber abilities, (b) to be 


oat ae 
8In many cases investigators have shown a 


curious inconsistency in believing that first- 
order factors should be rotated but second 
orders should be left where they fall! (The 
Schmidt-Leiman determination of loadings of 
variables on second orders, for example, as- 
sumes this.) In other cases, the explanation 
seems to be the usual exhaustion phenomenon, 
in which, by the time the investigator gets to 
the second order of a long factor analysis, 
neither time nor energy remains to press on to 
a determinate second-order resolution. Mainly, 
however, it seems that like early climbers on 
Everest, they have not dragged along at the 
early stages of the expedition the equipment 
which foresight might have indicated to be 
essential at the last stage of ascent. 


well-known factors, not merely variables, 
so that they would fan out into a maxi- 
mum number of dimensions to give sta- 
bility of rotation of the ability factors 
with respect to many reference points, 
and (c) themseives to have a known 
second-order structure, the emergence of 
which in the present blind rotation would 
give a check on its general correctness. 
These requirements? we felt to be best 
met by taking Personality Factors A 
through Q, (having the same meaning as 
on the 16 PF Test) on the High School 
Personality Questionnaire (HSPQ; Cat- 
tell & Beloff, 1959). 

The nine ability variables consisted 
of five Thurstone Primary Abilities— 
Verbal, Spatial, Reasoning, Number, and 
Fluency—and four subtests from the 
Institute of Personality and Ability Test- 
ing (IPAT) Culture Fair Intelligence 
Test, Scale 2a—namely, Perceptual 
Series, Perceptual Classification, Ma- 
trices, and Topology. If our hypothesis is 
correct all the Thurstone primaries, with 
thesexception of Spatial and possibly 
Fluency preformances should load on a 
crystallized ability factor (as also should 
be the case with each specific aid fac- 
tor).1° On the other hand, the Culture 


9 This procedure of entering the ability re- 
search with more personality than ability 
measures, may seem quixotic to conservative 
researchers, but in addition to the reasons 
given above it is actually strategically neces- 
sary in terms of demonstrating that second- 
order ability factors are in fact distinct from 
personality factors. This can by no means be 
taken for granted, since some “primary abili- 
ties,” e.g., flexibility of closure, now appear 
(Cattell, 1957a) as outcroppings of personality 
factors “in disguise” in the cognitive realm. 

10 A small note on a large issue is necessary 
here in connection with the notion raised above 
that an accumulation of separate aid develop- 
ments might constitute a general factor. The 
magnitude of the aid factor, Fa’ is a joint func- 
tion of F, and some environmental “accident” 
A‘, though whether it should be written as 
(a) Fa =F: XA, or, (b) Fai +A is un- 
certain. In either case A would be operating as 
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Fair subtests, being purely perceptual 
and lacking even pictorial reference to 
the not-present should load only a fluid 
general ability factor. However, since 
even the Verbal iterr decisions involve 
some immediate adaptive performance, 
the fluid factor should extend to some 
degree (in the rotation position defined 


a group factor covering from two or three to 
a large number of performances. : 

In the early stages of the operation of an aid, 
as suggested above, it should be detectable in 
either case as a group factor. In later stages, 
it would be possible for an accumulation of 
overlapping group factors to be resolved as a 
general factor, indeed, they would constitute 
part of the crystallized general ability. That a 
set of overlapping small group factors could 
alternatively appear as a general factor has 
puzzled factor analysts since the early debates 
of Thomson and Spearman on the interpreta- 
tion of g as a “sampling of bonds” versus a 
“single power.” This factor analytic prob- 
lem can be kept clear only by invoking the 
principle of organismic setting. 

This principle states that although each of 
a set of separate covariational entities may ap- 
pear as a separate group factor, yet, if they 
all have some quality in common, so thatithey 
can appear as part of a larger organization, 
then, by simple structure resolution, their sum 
will also appear as a single factor, in the con- 
text of several other, qualitatively different, 
such accumulations, Thus although each leaf in 
a heap of leaves is a separate entity and (if its 
variation, eg., in perception from various 
angles, were considered, a separate factor) yet 
the heap also has its dimensi 
among other heaps. Similarly for cells in an 
organism or people in a team. What one gets 
factor analytically depends upon the organis- 
mic level at which measurements and rotations 
are made. 

Even before one gets a shift of organismic 
level, a mere change of scale, from microscopic, 
or, in terms of psychological variables, from 
low to high density of representation of vari- 
ables, can convert the resolution from a mul- 
tiple group factor outcome to a 
outcome. Pending further ex 
pothesis is that the variance produced by 
cummulative action of distinct aids will, except 
for what is left in the truncated group factors 
(Cattell, 1962) become part of the crystallized 
general ability factor, i.e., Fı and F4 in Equa- 
tion 3 will both go into its variance, This 
states an important difference from Hunt’s 
(1961) theory. 


ions, as an entity, 


general factor 
periment our hy- 


by the wider realm of personality meas- 
ures) into such performances as Verbal, 
Spatial, etc., primaries. 

The choice of sample was made on the 
assumption that Horn’s (unpublished) 
research would use adults. For a com- 
plete answer on the above hypothesis 
requires a check on the expectation that 
the. crystallized intelligence factor will 
behave very differently (as ges and gen) 
with children and adults. There is some 
advantage in beginning with, say, 12- 
year-old children, because..we--nay ex- 
pect less complication from any decay 
term (C; in Equation 3). Also one might 
expect the g.s factor, based on so uni- 
form an area of earlier application, to 
be larger than with adults (about the 
same variance as the gr) and thus easier 
to locate in a first study. 


Data AND Its ANALYSIS 


The sample consisted of 124 eighth 
grade boys and girls from Paxton, Illi- 
nois, and 154 from the seventh and 
eighth grades of a junior high school in 
Springfield, Illinois, a total of 277 (ie, 
one dropped) being carried forward to 
the analysis. The Thurstone Primaries 
(except for Fluency) were given in both 
forms, and HSPQ was similarly given 
in separate A and B scores for each 
primary personality factor; but the Cul- 
ture Fair Intelligence Test used only 
one form (which must be remembered in 
appraising later saturations). 


took about 3 hours and was un 
examiner. 


Testing 
der one 


The first order analysis required 
product-moment correlations! for 44 
iis 

u The correlation matrix, centroid, lambda 
transformation, and final simple structure 
matrix have been deposited with the Ameri- 
can Documentation Institute. Order Document 
No. 7381 from ADI Auxiliary Publications 
Project, Photoduplication Service, Library of 
Congress; Washington 25, D. C, remitting in 
advance $1.25 for microfilm or $1.25 for photo- 
copies. Make checks payable to: Chief, Photo- 
duplication Service, Library of Congress, 
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` variables (9 Thurstone abilities, 4 Cul- 


ture Fair subtests, and 28 HSPQ per- 
sonality variables), i.e., in all 41 plus 3 
random variables for hyperplane testing. 
Since they consisted mainly of paired 
markers for factors, it was not surprising 
that the Tucker (Thurstone, 1938) and 
Guttman (Cattell & Sullivan, 1962) 
tests (separately applied) pointed to 
20-24 factors to be extracted. We settled 
on 22 as the limit for determinate, con- 
verged, iterated communalities and iter- 
ated four times to reasonable stability. 

The rotation for simple structure was 
carried out with extreme care, since as 
will now become apparent, all conclu- 
sions in the second order hinge upon the 
angle values settled upon in the first. 
Simple structure reached, after four 
overall rotations, the very high value of 
82% of all variables lying within the 
+.10 hyperplane. At this point in the 
blind rotations an inspection showed that 
the usually accepted structure for both 
the Thurstone Primary Abilities and 
HSPQ primary personality factors had 
emerged, independently, with excellent 
clarity. The two prescribed markers, 
and virtually nothing else, loaded each 
named factor. Although only one marker 
had been inserted for Fluency and each 
Culture Fair subtest, these five picked up 
enough on other variables, e.g., classifi- 
cation had loading on HSPQ Factor B, 
for each to appear as a nonspecific fac- 
tor, though they are in the usual wider 
sense, specifics. 

The Cpr matrix for this carefully ro- 
tated study was now inverted to give 
the correlations among the 22 factors 
(Cr=DCr”D) and this was again fac- 
tored. The advantage of proceeding to 
the second order from the Cr instead 
of from correlations of actual battery 
measures of the factors is that we elimi- 
nate distortions from the unreliabilities 
and imperfect validities of actual scales. 
In exchange we pick up whatever un- 
certainties remain in the simple structure 


rotation, but with at least 20 variables to 
define the hyperplane, this should be 
a lesser risk and offer a better design. 

Centroid factoring of the first-order 
22-factor matrix yielded, by the same 
pair of criteria as Before, 8 factors. Their 
simple structure rotation is shown in 
Table 1, together with Cp of their cor- 
relations (see Footnote 11). The simple 
structure here is no longer quite as clean 
as at the first order. If the oddity of 
Factor 7 is omitted (with which we are 
not múch concerned) the count is, how- 
ever, still 59%, which is high among 
reported studies and at any rate the 
essential maximum or plateau attainable 
among present possible rotations. 

The structure of Table 1 reveals un- 
mistakeably the distinctness of the fluid 
general ability pattern, which is Factor 1 
(loading the four subtests of the Culture 
Fair, the Thurstone Spatial, and the 
HSPQ Ego Strength, C, factor), and the 
crystallized general ability factor, Fac- 
tor 2, which loads Verbal ability, Rea- 
soning, and Number most highly. That 
these two ability factors, roughly orthog- 
onal to the remaining six, are essenti- 
ally in the right position is attested 
further by the correctness of the second- 
order factors emerging among these lat- 
ter personality factors. Factor 3 is the 
typical U.I. Q. I. (Cattell, 1957a) sec- 
ond-order extraversion factor (Carrigan, 
1960) covering the primaries A, D(—). 
F, H, Q.(—). Factor 4 is the gerieral 
Anxiety versus Adjustment factor— 
C(—), O, and Q,(—), (with Qs slightly 
anomalous); and Factor 5 continues 
these previously recognized second-order 
factors to include that indexed as U.I. Q. 
III (Cattell, 1957a). Although these 
are to be remarked here only as confir- 
mation of the “setting” for the two main 
ability factors, it is possible that Factor 
6—‘‘super-ego-good-upbringing” or Con- 
trol—has also some interaction with 
crystallized ability. 

Let us for the moment postpone ex- 
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TABLE 1 


SECOND-ORDER FACTORS AND THEIR INTERCORRELATIONS 


Part A: Factor loadings (in reference-vector correlation form) 


t Fa Fs F; Fa 

First order factor Fi Fa igya- . Fe UL Fo t 

variable ge e Invia Ansiety Q. Control ? ? 
a ag ads 13 46 —17 —03 04 oF og =i 
Spatial 32 .14 —.02 —.03 -03 05 —.27 04 
Reasoning 08 50 08 02 —.02 02 38 —.14 
Number 05 539 —.04 Se =F =05 19 03 
Fluency OT 09 —.52 —18 -12 28, M3 —.07 
i tests 

a ee ieee 35 43 05 —.12 .06 10 24 04 
Classification 63 —02 -—05 —05 .00 14 16 06 
Matrices © 50 10 —.23 04 ~01 —08 ~25 42 
Topology SLO 09 ë J6 2 W 03 lA 00 

HSP! 

TE T — 04 52 81 = 23 05 AT 20 03 
C Ego Strength 2l —07 —04 ~ 52 ~og — 09 —.49 12 
D Excitability —04 —44 44 09 09 04 di 27 
E Dominance =i; =M -.05 = 61 —04 —02 —17 
F Surgency —.05 -09 39 —.07 06 —.40 —.20 —.09 
G Super Ego Strength —.14 08 ~—0l1 —.10 —.10 43 Al 05 
H Parmia 21 —.04 55 —.17 .00 13 03 —.03 
I Premsia —.09 —.29 —05 26 —.54 —.05 43° —01 
J Coasthenia —.10 "—.04 01 39 —12 AS 01 16 
Q Timidity 416 —.01 .01 73 09 — 04 10 17 
Qe Self-Sufficient — .06 0 —37 —05 ~43 ~o4 _ 04 o5 
Qa Self-Sentiment Control 0S —,02 06 00 .32 35 56 11 
Q: High Ergic Tension — .04 37 03 45  —00 —.37 — t 05 

% in +10 hyperplane 51 60 60 51 a3 55 32 60 

Part B: Factor correlations 

1. Fluid general ability 1.00 AT 29 35 09 21 —01 —.15 

2. Crystallized general ability AT 1.00 az 15 — 03 .28 03 = —.20 

3. Extroversion versus Invia .29 17 1.00 17 —.01 10 —.24 — 5 

4. Anxiety versus Adjustment 3s 15 17 1.00 24 06 14 —~ 12 

5. UI. Q. M 09 -—03 —01 24 100 —.46 06 .26 

6. Control 21 28 10 06 —.46 1.00 07 —.70 

7? — 01 0 —.24 14 06 07 100 —.11 

8. ? —15 —20 —os —.12 26 —.70 —~ 11 1.00 


perimental examination of our assump- 
tions about the inherent modes of ex- 
pression of these two factors as shown 
by loadings and pause to examine their 
mutual relation as shown in Tables 1 
and 2. The substantial positive corre- 
lation, +.47, shown in Table 1, Part B, 
is what would be expected from our 


theory, on the grounds that both must 
be highly related to an entity which 
existed a few years earlier, and which we 
have symbolized (Equation 3) by Fie 
(Or gre)—the fluid ability level earlier. 
The present crystallized ability leyel— 
Fz (or ge)—is a function of Fie and the 
time and interest applied at that time. 


re) 
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The present fluid ability level—F., (or 
g:)—is an organic continuation of Fie, 
falling short of perfect correlation with 
it only because different times have 
elapsed for different people and the in- 
terlude has treated them more or less 
kindly in terms of brain damage, ete. 

If next we ask what this correlation 
implies in terms of a third-order analysis, 
different theories will give different an- 
swers. Our theory would posit that F, 
and F, (g. and gr) should come together 
in a singlehicher order factor, because 
historically a single influence, Fie, is re- 
sponsible for them both. It has, so to 
speak, fathered F, out of time (as “the 
child is father of the man”) by simple 
maturation, and F, out of experience by 
interest and learning investment. 
Whether the third-order Fie should load 
higher on F, or F, depends on many 
things. High similarity of experiences 
(including time length) and_ interest 
should raise the loading on F», whereas 
heterogeneity of the group in this respect 
should lower it. Heterogeneity of the 
group in age and time lapse since the 
formative period of ge should lower the 
loading in F,. In a group of school 
children such as the present, in the 
midst of their growth period, the Fie 
loading in F, should be quite high and 
that in F, a little short thereof. In adults 
or children more heterogeneous for age, 
the loadings should both be lower. 

The third-order analysis designed to 
test these hypotheses again had, by rea- 
Son of the initial planning, enough hyper- 
plane stuff to determine the rotation of 
this still broader general ability factor. 
Further, the rotation was again made 
with pure factor measures, not error- 
contaminated actual battery scores, for 
simple structure was attained in the ref- 
erence vector matrix underlying Cr 
Shown in Table 1. In this Cp four factors 
were indicated by the Tucker test and a 
Satisfactory 63% in the hyperplane was 


TABLE 2 


THIRD-ORDER FACTORS AND INTERCORRELATIONS 


Third-order primary factors 
Second-order factors AOE Pre Sees 


1. 2. 3. 4. 

Fluid intelligence, -69 02 —.07 -00 

C lized intelligence 63 —.04 07 32 
E: ersion versus Invia 

(U.I. Q. 1) 1S 03 38 23 


Anxiety versus Adjustment 


(U.I. Q. II) Š —.01 01 -00 79 
UT Q TIE 09 —.51 —.07 32 
Control 01 99 —.03 —.05 
F: .06 03 —,74 -04 
Fi .02 —.69 Os —.06 


o in =.]0 hyperplane 


Primary factor correlations at third order 


Pone 
z 
Rint 
t=) 
5: 
=) 
a 


obtained after five overall rotations, with 
results shown in Table 2. 

If our hypotheses is correct it would 
not be right to conclude from Table 2 
that “fluid and crystallized general 
ability form a single third-order factor,” 
but rather that a single influence, which 
is fluid ability as it stood during the 
formative period of crystallized ability, 
is causative to the present levels of both. 
That this “formative fluid ability” influ- 
ence is in fact F; in Table 2 could be 
checked by preserved records of the 
subjects’ earlier fluid ability scores. It 
is noteworthy in Table 2 that this fluid 
ability factor has no significant loading 
on any personality factor, but stands as 
a measure of pure ability. On the other 
hand, it has slight, significant correla- 
tions as a factor with control and anxiety 
of a kind we have come to expect from 
the linking of intelligence with other 
factors through the natural selection of 
social status (Cattell, 1945; Fisher, 
1958). The factor contingently dubbed 
Control here has, on the other hand, 
significant relations to crystallized 
ability in Table 1 and must be consid- 
ered one of the personality factors con- 
tributing, partly by aiding school memo- 
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rizing, to crystallized ability, via Fyr, 
etc., in Equation 3 above. 


NATURES or FLUID AND CRYSTALLIZED 
INTELLIGENCE 
S 


With concepts defined and checked at 
the experimental level we can now pro- 
ceed to broader formulations. The state- 
ments so far are: 


1. That intelligence test and school 
performances must be considered, more 
comprehensively than hitherto, to be de- 
termined, at the moment, by personality 
and motivation factors as well as by two 
distinct second-order general factors, 
(fluid and crystallized intelligence) as 
symbolized in Equation 2. Equation 2 
is primarily an expression for perform- 
ance in a timed test, but with trivial 
adjustments, is also an expression for 


third-order ge 


achievement (for children) and adult 
activity achievement (for adults) are 


in manifestation to the ha, 
plex relations, whereas the latter could 
cover whatever the breadth of the cul- 
tural schooling curriculum embraces, 


A special logical complexity arises 
here, however, in that rate of learning in 
complex fields is assisted both by fluid 


and crystallized general abilities, as well 
as by such aids (usually primary, group 
factor patterns) as are relevant to the 
particular field (Equation 3). Conse- 
quently, crystallized ability must be con- 
sidered to be begotten by crystallized 
ability as well as by fluid ability. This 
may seem to contradict the concept 
ahove that crystallized ability is a 
consequence and function of fluid ability 
levels, but it is not so if we consider (a) 
that fluid ability is so to speak put out 
at compound interest, ang recognize 
also that the rate of return may be dif- 
ferent over different periods of learning, 
depending on interest, etc.; and (b) 
that crystallized ability is not only a 
function of fluid ability but also of per- 
sonality factors, etc, Thus personality 
factor “deposits” occur in what at the 
time of learning is considered an ability 
—crystallized general ability—and also 
in aids. If Space permitted, these rela- 
tions of earlier personality and motiva- 
tion factors, as operating in Equation 2 
to crystallized abilities as in Equation 
3, could be worked out in a fourth or 
“historical depth” equation. 

As to the descriptive similarities and 
differences of Sr and ge, both are very 
general to complex, intellectual, rela- 
tion-perceiving performances, and even 
in regard to the variables chosen to dis- 
criminate them one notices, in Figure il 
that each has some tendency to load the 
variables set to mark the other, However, 


n parallel to the axes 
tenthetically, it will be 
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Roe J. Culture-fair subtests and Thurstone 
panes in relation to ge and ge. (Rotation 
assisted by 16 PF factors in hyperplane.) 


(especially in the absence of D, I, A, 
and Q.) by going through the ability 
variables only, e.g., through Verbal and 
Topology. i 
Figure 1 also confirms the whole argu- 
ment of Equation 2 to the effect that 
crystallized intelligence, being partly the 
ouet of motivational and personality 
os ory, will have more significant asso- 
` ation with personality factors. This 
Pai is not only statistically sig- 
for cant but makes psychological sense, 
Seek ability correlates sub- 
(Fa ony Positively with Cyclothymia 
mite E A in HSPQ), and negatively 
wie xcitability (D), and Premsia (1) 
oon a other researches show to be 
ten y related to general school 
tion vement. Similarly in the motiva- 
an eal (Connor, 1961), docility (low 
haya n and super ego strength 
T bl highest correlation with total 
eo achievement. Their correlations 
aia Verbal (V) factor, the Rea- 
mn g (R) factor, and the Culture Fair 
p respectively, .20, .48, and .02; and 
thiet X and ~ 02, (see Footnote 10) 
consist ture Fair (fluid ability) measures 
lon ag being more free of associa- 
achie, ith personality factors affecting 
zement, As stated above, this 


greater freedom of the second-order 
fluid ability from personality loadings, 
which supports our hypothesis, is not 
incompatible with its having correla- 
tions therewith at the third order, point- 
ing to genetic and social status ties.** 

A word is necessary here to forestall 
a misunderstanding which will almost 
certainly arise in the attempt of con- 
servatives to avoid any major restructur- 
ing of ideas. This will be the view that 
gr is ncthing more than the k or “prac- 
tical ability” factor, located by such 
factorizations as those of Vernon (1950) 
and Cohen (1957). There are three good 
reasons for rejecting this. The first, 
comparatively trivial, is that k has al- 
ways shown decided associations with 
masculinity and mechanical experience 
whereas in our mixed boy and girl sam- 
ple ge shows statistically no difference 
and is actually a shade higher for the 
girls. Secondly, and more systemati- 
cally, the whole mode of factor resolution 
in the, Burt-Holzinger-Vernon bipolar 
system is quite different from multiple- 
factor simple-structure resolution and 
never yields a one-to-one matching. The 
former method puts verbal ability on one 
side and practical-mechanical on the 
other. In the present writer’s opinion 
this is in any case a fallacious form of 
factor resolution, for since the first gen- 
eral factor is indeterminate, the whole 
hierarchy is fictitious. But, fallacious.or 
not, it is, except by some accidental 


12In looking for indications of some sep- 
arate action of the interest-personality factors 
posited in Equations 1, 2, etc., one may note 
in Table 1 that Factors 6 and 7 admit of a 
single factor being rotated from them which 
loads the two Super Ego factors, G and Qs; 
Desurgency, F(—); and positive performance 
on Reasoning, Fluency, Series, and Classi- 
fication. It makes good psychological sense that 
such cognitive performances should be aided 
by such personality factors, but it suggests 
they are acting in the present test situation 
(as in Equation 1) rather than through help in 
past performance as in Equation 3. 


18 Raymonp B. CATTELL 


caricature, too different for gẹ ever to 
be identified with k. Finally, however, 
gr is not particularly loaded on mechani- 
cal aptitude variables (the evidence is 
not given here, but in Horn, unpub- 
lished), or in spatial ability measures, or 
one-sidedly in any of those performances 
which have been included in this vague 
and impractical practical ability artifact. 
On the last issue—that of giving us a 
far more complete descriptive differenti- 
ation of gr and ge in the extent and 
nature of their loading fields—there is 
admittedly a great deal still to be found 
out. Considering the volumes of ability 
correlating that have gone on over the 
past 20 years it has been, to say the 
least, theoretically uninspired. Espe- 
cially the hypothesis should be tested 
that g.’s loading pattern will alter with 
age, subculture, and culture whereas g;’s 
will not. Already such studies as that 
of Sisk (1940) Point to the effect on the 
form of the crystallized intelligence pat- 
tern of such very local influences as an 
“interest in study” over particular col- 
lege courses shared by members of a 
group. However, one unjustified as- 
sumption needs to be scotched which 
has been, among teachers, as obstructive 
in holding up the practical introduction 
of culture-fair tests, as the k illusion has 
been in buttressing outworn theory. This 
is the “faith validity” judgment that be- 
cause such tests employ shapes they 
must be testing spatial ability, As Fig- 
ure 1 shows, the loading of the fluid 
general intelligence factor is not as great 
in Spatial as in Matrices, Topology, and 
Series tests, and though such tests de- 
pend on perception there is as yet no 
evidence that they load unduly Thurs- 
tone’s perceptual factors. 
If, as stated at the outset, the theo- 
retical aim of culture-fair intelligence 
subtest construction is to require com- 
plex relation eduction in material that 
is either completely new to or completely 


overlearnt by all persons to be tested, it 
is of interest to discover what these 
areas may be, A systematic attack on 
this was begun some years ago in the 
work of Cattell (1940), Line (1931), 
Fortes (1931), and others and pointed 
to simple spatial perception, shade and 
pitch perception, and probably tactile 
experience and awareness of the body, 
as being sufficiently overlearnt in most 
cultures, but this exploration was never 
continued. Meanwhile, from a practical 
intelligence test construstion ‘standpoint 
it is interesting to note that the Classi- 
fication, Topology and somewhat less, 
the Matrices tests are good measures of 
fluid ability (at any rate as used in the 
Culture Fair Test) and Number, Rea- 
soning and Verbal primaries of crystal- 
lized ability. Incidentally, the evidence 
of cultural learning in the Series test 
is a bit surprising. 

While commenting on odd loadings in 
Table 1 one may note also the loading 
which a factor, Number 8, outside the 
general ability factors, has on the M 
trices test. The Present writer has else- 
where argued, on the theoretical likeli- 
hood of such a loading, against the le- 
gitimacy of using Matrices alone, for 
measuring fluid general intelligence, in- 
stead of a complete Culture Fair battery 
averaging several subtests. This shows 
that indeed appreciable specifics or 
extra factors are as likely to occur in 
perceptual as in traditional subtests. It 
is possible they will not Prove to be cog- 
nitive specifics, but, as the present analy- 
sis Suggests, less than half of the variance 
in Matrices appears to lie in general in- 
telligence, and the rest is sheer unknown 
bias in the test measurement if Matrices 
alone is used as an intelligence test. 

As to the present accuracy of estimate 
of F, and F, the loadings of the subtests 
in the Culture Fair battery’ on the fluid 


a- 


1# The search for furth 


er good subtests might 
now be guided by the 


emerging theory that 


ip 
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ability factor are, in general, as good as, 
or a little better than, those of the 
Thurstone primaries on the crystallized 
ie factor (mean=.40 as against 


NEEDED RESEARCH 


At the present moment researches on 
these theories are as vital in the applied 
as in the basic field. For if the main 
concepts are correct, present routine test- 
Ing practives-*n school, and still more in 
vocational selection of adults, are wast- 
ing a lot of talent, The traditional in- 
telligence test, because it confounds fluid 
with crystallized intelligence and even 
with the third-order general attainment 
factor, gives a speciously good correla- 
tion, at least in schools, with the crite- 
rion. A test in June predicts academic 
achievement in June (or even in the 
following September) for the simple 
reason that it already surreptitiously 
contains in itself most of the criterion it 
is claiming to predict. In fact, if short- 
ae a is all that is required it 
ear be sensible to abolish intelligence 
tests and predict from today’s school 
achievement to tomorrow’s. 

But the idea of introducing intelli- 
gence tests has surely much broader ob- 
oe It aims to give psychological 

erstanding of causes of backwardness 


ce ability shows itself most highly, relative 
irk stallized ability, in complex relation and 
tallis ate eduction performances where crys- 
sain ed ability is climinated either by (a) all 
Oe being entirely untrained in the per- 
Plet ER or (b).all subjects being com- 
the €ly overlearnt in the fundaments (but not 
pemi oO else intelligence would disap- 
4, Tor Possibly Culture Fair Subtest Number 
ate oan is an example of the former and 
> mse ability of the latter, since the latter is 
fox mmon requirement of bodily movement 
one Pole in all cultures. This definition of 
to be sporty of the fluid general ability needs 
Other E ESE pursued in relation to the 
that ypothesized properties above, now 
the factor can be isolated. 


or sources of high performance, to per- 
mit prediction of more remote perform- 
ances in time and place, and to permit us 
to apply a psychological science via 
functional analytical concepts. The 
writer had a student who never went to 
school till 17, who was soon getting 
straight A’s as a junior in college, he 
did splendidly „on a culture-fair test at 
17 but would ‘have been excluded from 
college on his traditional intelligence 
test or achievement performance. The 
discrepancy of ge and gr is, however, 
mostly small in the school years, so long 
as we have homogeneity of school, cul- 
tural subgroup, and social status. It is 
in the adult field, e.g., in selecting for an 
intelligence-demanding learning oppor- 
tunity among persons of different ages 
and distances from school activities, in 
different regions, that failure to measure 
ge and ge separately could lead to serious 
misdirection. How fair is the Miller 
Analogies to engineering students com- 
peting, for graduate school positions 
against English majors, compared with 
a culture-fair test? It is well known 
that the norms of extensively standard- 
ized traditional intelligence tests are 
invalidated within 2 or 3 years of their 
production by changing (usually in- 
creased!) school and cultural education 
levels. Is this intergenerational “creep” 
of norms on crystallized intelligence 
tests avoided by culture-fair tests, as 
preliminary data (Cattell, 1957b) in- 
dicates? These are the problems which 
applied research should be facing. 

In terms of basic research a realm 
of fascinating concepts and possibilities 
is opened up. Is it possible that gr 
minus ge might be the best predictor of 
organic brain damage? Can ge and ge 
also be separated by intraindividual, P 
technique factoring, demonstrating the 
functional unity of each in terms of sus- 
ceptibility to day-to-day changing con- 
ditions and stimuli? What clarity might 
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be brought to the vexed question of pre- 
school ability organization by these con- 
cepts? (There are important leads here 
in the work of Burt, 1955; Hebb, 1942; 
Hofstaetter, 1954; McNemar, 1940; 
Reitan, 1958.) Will nature-nurture ra- 
tios calculated on gẹ measures prove to 
be altogether more highly genetically 
determined than ge measures? Is the ge 
IQ more constant? 


Is it possible that what Thurstone 
called primary ability factors are psy- 
chologically the same as what we have 
called aids above? Probably both will 
consistently appear as first-order factors, 
relative to g. and gy as second order, and, 
although some may well be genetic in 
origin, the theory is worth 
that many first orders 
growths from a s 
(in the form of hi 


discovery of each aid (in- 
strument for further Problem Solving) oe 
be partly a function of fluid ability Je 


‘actor of crys- 
tallized ability. The Fa’s of Equation 3 would 
represent, therefore, only the narrow group 
factor variance left o 


5 rption 
in the general factor, 


Raysonp B. CATTELL 


sroups at 30 and 50 years of age; with 
adults heterogeneous as to age; and with 
mixed “normals” and known brain dam- 
aged cases. It needs to be tried with 
larger ranges of variables, identically 
used with two or three different cultural 
groups, to see whether the third-order 
achievement general factor can be sepa- 
fated both from the second-order crys- 
tallized intelligence and fluid intelligence 
factors, and especially we need age plots 
of the differing course of these two fac- 


tors, each with and withouy speed limits 
in testing. 


SUMMARY 


and crystallized 
actors has been ex- 
an array of implica- 
has been drawn be- 
i factor and 


n experiment factorin 
ses-relevant variables me 
Seventh and eighth 
with sufficient non 


8 44 hypothe- 
asured on 277 
grade boys and girls, 
cognitive variables to 
tation of 


“practical 
intelli r, but basic general 
ntelligence, These two general abilities 


y” Partly responsible for the 
Present level of both of them. 


Ne 


FLUID AND CRYSTALLIZED INTELLIGENCE 21 


BIBLIOGRAPHY 


ANASTASI, A. The influence of specific experi- 
ence upon mental organizatio 
chol. Monogr., 1936, 18, 245-355. 

BARGMANN, R. A demonstration study of the 
effectiveness of factor analytical models. 
Frankfurt: Hochschule fuer Internationale 
Paedagogische Forschung, 1955. 

Biewerr, D. Twin studies on the inheritance 
of intelligence and general neuroticism. Un- 
published doctoral dissertation, University 
of London Library, 1954. (a) i 

BLEWETT, D. B. An experimental study of the 
inheritance of intelligence. J. ment. Scis 
1954, 100, 54-69. (b) 

BRAINE, M. D7 S. The ontogeny of certain 
logical operations: Piaget’s formulation ex- 
me by nonverbal methods. Psychol. 

B onogr., 1959, 73(5, Whole No. 475). 
urks, B. S. The relative influence of nature 
= nurture upon mental development. 

earbook Nat. Soc. Stud. Educ., 1928, 27, 
219-236. 

Burr, C. L. The evidence for the concept of 
intelligence. Brit. J. educ. Psychol., 1955, 25, 
158-177, 

Carrican, P. M. Extraversion-introversion as 
dimension of personality: A re-appraisal. 

& sychol. Bull., 1960, 57, 329-360. 

ARROLL, J. B. The factorial representation of 
et ability and academic achievement. 

one psychol. Measmt., 1943, 4, 307-332. 
ene R. B. The Cattell Group Intelligence 
nie Scales 0, 1, 2 and 3. London: Harrap, 

Canti; R. B. The fight for our national in- 

Gea London: P. S. King, 1937. 
Pai? R. B. A culture-free intelligence test: 

Carne . J. educ. Psychol., 1940, 31, 161-179. 
litine Some theoretical issues in gat 

E See, testing. Psychol. Bull., 1941, 
foe R. B. The measurement of adult 

Gim igence. Psychol. Bull., 1943, 3, 153-193. 
dee R. B. The cultural functions of s0- 
k | stratification: I. Regarding the genetic 
an of society. J. soc. Psychol., 1945, 21, 

es, R. B. Personality: A systematic the- 
v e and .factual study. New York: 
ee cGraw-Hill, 1950. 

TELL, R. B. Factor analysis. New York: 
jnitper, 1952, 
be R. B. A note on Dr. Sloan’s evidence 
aire tan the value of culture free intelli- 

psoe: s. Amer. J. ment. Defic., 1955, 59, 
ATTELL, R. B. Personality and motivation 


structure and measurement. New York: 
Harcourt, Brace & World, 1957. (a) 

CATTELL, R. B. The IPAT Culture Fair In- 
telligence Scales. Champaign, Ill.: Institute 
for Personality and Ability Testing, 1957. 
(b) 

CATTELL, R. B. A universal index for psycho- 
logical factors. Psychologia, 1957, 1, 74- 
85. (c) 

CATTELL, R. B. The basis of recognition and 
interpretation of factors. Educ. psychol, 
Measmt., 1962, in press. 

CATTELL, R. B., & BELOFF, H. The High School 
Personality Questionnaire. Champaign, Ill.: 
Institute for Personality and Ability Testing, 
1959. 

CATTELL, R. B., & DICKMAN, K. A dynamic 
model of physical influences demonstrating 
the necessity of oblique simple structure. 
Psychol. Bull., 1962, 59, 389-400. 

Cattetr, R. B., Stice, G. F., & Kristy, N. F. 
A first approximation to nature-nurture ra- 
tios for eleven primary personality factors in 
objective tests. J. abnorm. soc. Psychol., 
1957, 54, 143-159. 

Carrett, R. B., & SULLIVAN, W. The scien- 
tific nature of factors: A demonstration by 
cups of coffee. Behav. Sci., 1962, 7, 184-193. 

CATTELL, R. B., & WARBURTON, F. W. Objec- 
tive pèrsonality and motivation tests: A 
theoretical introduction and practical com- 
pendium. Urbana: Univer. Illinois Press, 
1963. 

Comen, J. The factorial structure of the WAIS 
between early adulthood and old age. J. 
consult. Psychol., 1957, 21, 283-290. 

Connor, D. The prediction of educational 
achievement from objective motivation fac- 
tor measurement. Paper read at Midwestern 
Psychological Association Annual Meeting, 
Chicago, May 1961. 

Ex Koussy, A. H. A note on the Greys Anil- 
ogy Test. Brit. J. educ. Psychol., 1938, 4, 
294. 

Fercuson, G. A. On transfer and the abilities 
of man. Canad. J. Psychol., 1956, 10, 121- 
131. 

Fisuer, R. A. The genetical theory of natural 
selection. (2nd rev. ed.) New York: Dover, 
1958. 

FLEISHMAN, E. A., & HEMPEL, 
in factor structure of a comp 
motor task as a function of praci 
chometrika, 1954, 19, 239-252. , 

Forcus, R. H. Early visual and motor experi- 


ence as determiners of complex maze learn- 


ing ability under complex and rich and re- 


W. E. Changes 
lex psycho- 
tice. Psy- 


22 Raymonp B. CATTELL 


duced stimulation. J. comp. physiol. Psy- 
chol., 1955, 48, 215-220. 


Fortes, M. A study of cognitive error. Brit. 


. educ. Psychol., 1932, 2, 297-318. 

Mea Ty W. The description of aptitude and 
achievement tests in terms of rotated factors. 
Psychological Monograph No. 5, 1951, Uni- 
versity of Chicago Press. 

Greene, E. B. An analysis of random and 
systematic changes with practice. Psycho- 
metrika, 1953, 8, 37-52. 

GvuILFoRD, J. P., CHRISTENSEN, P. R. Bonp, 
M. A., & Sutton, M. A. A factor analysis 
study of human interests. Psychol. Monogr., 
1954, 68(4, Whole No. 375). , 

Harrow, H. F. Motivation as a fdctor in the 
acquisition of new responses. „In, Current 
theory and research in motivation: A sym- 
posium. Lincoln; Univer. Nebraska Press, 
1953. Pp. 24-49, 

Haves, K. J. Genes, drives and intellect. Psy- 
chol. Rep., 1962, 10, 299-342. 

Hess, D. O. The effect of early and late brain 
injury upon test scores, and the nature of 
normal adult intelligence. Proc. Amer, Phil. 
Soc., 1942, 85, 275-292. 

HOFSTAETTER, P. R. The changing composi- 
tion of intelligence: A study in T-technique. 
J. genet. Psychol., 1954, 85, 159-164, 

Humpnreys, L. G. Discussion of Dr. Fergu- 
son’s paper. In P. H. Dubois, W. H. Man. 
ning, & C. F. Spies (Eds), Factor analysis 
and related techniques in the study of 
learning. Technical Report No. 7, 1959, Con- 
tract No. Nonr-816(02), Office of Naval 
Research, Pp. 183-187. 

Humpureys, L. G. The o 
man abilities, 
475-483, 


Hunt, J. McV. Intelligence and experience. 
New York: Ronald, 1961. 

LANSDELL, H, Latera’ 
in the brain. Scie 

Lasutey, K, S 


behavior. In K S Lashley (Ed.), The 


neuropsychology of Lashley. New York: 
McGraw-Hill, 1960, Hi 


rganization of hu- 
Amer. Psychologist, 1962, 17, 


Lord, F. M. The meas 


urement of growth, 
Educ. psychol. Measmt 5 


» 1956, 16, 421-437, 


Lorn, F. M. Further problems in measurement 
of growth. Educ. psychol. Measmt., 1958, 
18, 437-451. 

McNemar, Q. A critical examination of the 
University of Iowa studies of environmental 
influences upon the IQ. Psychol. Bull., 1940, 
37, 63-92. 

Newtanp, T. E. The assessment of excep- 
tional children. In W. M. Cruickshank (Ed.), 
Psychology of exceptional children and 
youth. New York: Prentice-Hall, 1962. 
Ch. 2. 

PENROSE, L, F., & Raven, J. G. A new series 
of perceptual test: Preliminary communica- 
tion. Brit. J. med. Psychol., 1936, 16, 28-30. 

Pucet, J. The psychology of intelligence. 
London: Routledge & Kegan Paul, 1947. , 

Pripram, K., H. A review of theory in physi- 
ological psychology. Annu. Rev. Psychol., 
1960, 11, 1-40. 

Reiten, R. M. Qualitative versus quantitative 
mental changes following brain damages J. 
Psychol., 1958, 46, 339-346. 

Sisk, H. L. A multiple factor analysis of men- 
tal abilities in the freshman engincering cur- 
riculum. J, Psychol., 1940, 9, 165-177. 

Spearman, C. The abilities of man. London: 
Macmillan, 1932, , 

Sweney, A. B., & CATTELL, R. B. Dynamic 
factors in twelve year old children as re- 
vealed in measures of integrated motivation. 
J. clin. Psychol., 1961, 17, 360-369. 

THURSTONE, L. L, Primary mental abilities. 
Chicago: Univer, Chicago Press, 1938. 

THURSTONE, L. L. Multiple factor analysis. 
Chicago: Univer. Chicago Press, 1947, 

Tucker, L. R. Determination of generalized 
learning curves by factor analysis, In P. H. 
Dubois, W. H, Manning, & C. F, Spies 
(Eds.), Factor analysis and related tech- 
niques in the study of learning. Technical 
Report No. 7, 1959, Contract No, Nonr- 
816(02), Office of Naval Research, 

VERNON, P, E. The structure of human abili- 
ties. New York: Wiley, 1950, 

Wooprow, H. The relation between abilities 
and improvement with Practice. J. educ. 
Psychol., 1938, 29, 215-230, 

Wooprow, H. Factors in improvement with 
Practice. J. Psychol., 1939, 7, 55-70, 


(Received April 20, 1962) 


6 rains 


a 


Journal of Educational Ps: 
ycholo, 
1963, Vol. 54, No. 1, 23-32 e 


RELATIONSHIPS BETWEEN TEACHER NEEDS 
AND TEACHER BEHAVIOR IN THE CLASSROOM ' 


NORMAN E. WALLEN, ROBERT M. W. TRAVERS, IAN E. REID, 
axp KENNETH H. WODTKE 


University of Utah 


2 samples of elementary school teachers (N= 77 and 41) were studied 
with respect to consistencies between classroom behavior and “needs” as 


measured by a paper-and-pencil questionnaire. 
device provided scores on Achievement, Affiliation, 
Behavioral data consisted of observations recorded as 


Control needs. 


ratings and also as Q sorts and an analysis 0} 
the teachers. The principal findings were: 


tionships among the various measures of teach 
(b) a significant negative relationship between 


and Affiliation dimensions, 


Control and Affiliation behavior as viewed by the observers, 
0-.50) between Control need as measured 


nificant positive correlations (3 


The paper-and-pencil 
Recognition, and 


f verbal statements made by 
(a) significant positive rela- 
er behavior on the Control 


and (c) sig- 


by the questionnaire and controlling behavior of the teachers. 


a 


In recent years, many writers have ex- 
pressed the view that major improve- 
ments in education must await further 
knowledge as to the actual classroom be- 
havior of teachers and its consequences 
for student behavior. Notable contribu- 
tions to this problem have been made by 
Ryans (1960), Medley and Mitzel 
(1959), Cogan (1958), Washburne and 
Heil (1960), and others. An important 
aspect of the general problem is the ex- 
tent to which teacher behavior is measur- 
able and predictable. The study here 
reported is an attempt to delineate di- 
mensions of classroom behavior of ele- 
mentary school teachers and to assess 
their predictability by paper-and-pencil 
measures of need. 


SAMPLE 


Two samples of teachers were involved in 
the study. The first sample consisted of 77 
teachers in Grades K through 6 representing 
five schools in Salt Lake City. In selecting 
these schools attention was given to securing 
a variety of socioeconomic backgrounds. The 
second sample consisted of 41 teachers repre- 
— 

1 The research reported herein was supported 
through the Cooperative Research Program 
of the Office of Education, United States De- 
Partment of Health, Education, and Welfare. 
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senting two schools in a suburban, semirural 
community. There are differences between the 
two samples as indicated by different patterns 
of intercorrelations among some predictor and 
behavioral measures used in the study and by 
the fact that there is a greater turnover in 
personnel in the Salt Lake City schools than 
in the suburban schools. The teachers varied 
across tha entire range of age and experience. 
Good cooperation was obtained. Only four 
teachers refused to admit the project staff to 
their classrooms, though with one exception 
they were friendly in other respects. On occa- 
sion teachers would indicate that they would 
rather the observer return at another time but 
these incidents were infrequent. 


MEASURES OF TEACHER BEHAVIOR 


Our primary interest was in the following 
postulated dimensions of teacher behavior: « 


1. Achievement: degree of emphasis on aca- 
demic activities and the importance of excel- 
lence 

2. Affiliation: degree of interaction with 
students and emphasis on warm personal re- 
lationships 

3. Control: degree to which the moment to 
moment behavior of students is controlled by 
the teacher 

4. Recognition: degree to which the teacher 
is the center of attention 

Two means of assessing these dimensions 
were used. The first was based on sampling 
of the verbal behavior of the teacher; the 
second consisted of observer ratings and elab- 
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orations thereof. Each of the participating 
teachers was visited in class by two members 
of the research team. After preliminary visits 
to reduce the effect of an observer, data collec- 
tion was begun. Each teacher was visited at 
least three times by each observer. Three de- 
vices were used as follows. 

Adaptation of the technique developed by 
Withall (1949). This technique provides a 
sample of the teacher’s verbal behavior by re- 
cording verbatim the first utterance made dur- 
ing consecutive 1-minute periods. Each ob- 
server collected two samples of 25 statements 
each, resulting in a total of 100 statements for 
each teacher over a minimum of four obser- 
vation periods. 

The statements were subsequently classified 
into a system containing 26 categories. Our 
procedure was to have three persons score each 
teacher statement; the category assigned by at 
least two of the three scorérs was accepted. 
This criterion was achieved for 94% of the 
statements. Categories were then combined to 
provide scores for Achievement, Affiliation, and 
Control behaviors and for a dimension reflect- 
ing activities related to classroom Manage- 

was not ap- 
The reliability of 
ed by means of 
of variance tech- 


cited earlier (Achievement, Affiliation, 
nition, 
other dimensions gleaned from prior ri 
including amount of time spent alone 
vigor, confidence, etc. These latter ra 
not discussed furt! 


esearch, 
in class, 


even in cases 
res based on 
d predictably 
more instances 
The reason may 
TY scores reflect 
in a particular 


be that high and low summa 
a characteristic strong enough 
teacher to be agreed upon by the raters } Cases 
of disagreement receive summary scores in the 
middle of the distribution. Thus a summary 
score may have considerable validity. 


Factor scores derived from Q sorts. In ad- 


dition to independent ratings, a Q sort pro- 
cedure was used. This procedure has several 
advantages over ratings. First, it permits the 
systematic comparison of each teacher with 
every other with respect to each characteristic, 
hence providing a more stable frame of refer- 
ence. Second, it permits the observers to arrive 
at a consensual evaluation based on discussion 
as opposed to an additive pooling of their indi- 
vidual assessments. 

The disadvantages of this procedure are that 
the assessments are further removed in time 
from the behavior of the teachers and that the 
consensual assessment may introduce error 
resulting from the personal interaction of the 
observers. 

The following procedure was followed for 
each of the two samples of teachers. A deck 
of cards was prepared with one card for each 
teacher. Photographs were taken of all of 
the teachers who would consent and the pic- 
tures were pasted on the cards. The purpose 
of this was to provide a reminder of each 
teacher for the raters. Pictures were obtained 
for 60 of the 77 teachers in Sample 1 and 39 
of the 41 teachers in Sample 2. Each of the 
24 traits was then discussed with respect to 
particular teachers before an attempt was made 
to sort the entire batch of cards into the pre- 
scribed categories. 

The sort was conducted to provide the fol- 
lowing proportions of cases over seven cate- 
gories: .07, .12, .18, .24, 18, .12, .07. The 
procedure was as follows: As each card was 
turned, each sorter independently assigned it 
a numerical value corresponding to one of 
the seven piles. If there was disagreement be- 
tween the two sorters, the final placement was 
decided after discussion. The sorters were im- 
pressed with a rather high degree of agreement 
though observer correlations were not com- 
puted. Following this process, cards were 
shuffled up or down in the sequence of piles, by 
mutual agreement, until the correct number 
was obtained in each pile. 

In performing these Q sorts, the research 
workers were concerned only with behavior 
of the teachers within the classroom. This is a 
point to be emphasized since in some cases 
there seemed to be striking differences between 
the behavior of the teacher in the classroom 
and behavior in other situations in which these 
teachers could be observed. In addition, an 
attempt was made to consider the behavior 
of the teacher in relation to that of the child. 
If, for example, the degree of hostility of the 
teacher was to be judged then the judgment 
was made as to whether the pupils reacted as 
though the teacher were hostile. This problem 
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TABLE 1 


RoraTep Factor Matrix—Varprax SoLUTION—Q Sort Data 


Variable = - Factor 
a 1 2 3 4 5 
1. Aloofi—Response 81 02 PES 10 14 
2. Harsh—Kindly 85 18 — 25 is 22 02 
3. Dull—Stimulating 46 —.63 =a ~ 13 = 24 
4. Excitable—Controlled a 26 77 =4 — .06 16 
5 ata parte 35 —.14 m oS —.21 
z i isorganized—Systematic —.13 —08 —49 os —.52 
$ enbi Adaptable 88 01 —.21 10 11 
Hy on Hah — 84 — .02 .22 18 07 
ib w direct control—Little direct control 64 ° 27 .06 06 40 
ia learning-—-Lack of concern for 
ming .08 28 10 —.22 87 
i Jokes, laughs—Serious — 08 27 .21 —.05 06 
w geny punishes—Gives support 63 49-31 -11 10 
+ Much emotional evidence of frustration—Little e 
jä A peni of emotional frustration 27 — 73 —.06 —.03 
is Pe Quiet —.05 86 7 .00 21 
5 ancien often as a source of knowledge— 
a nae ions seldom as a source of knowledge Ol 49 14 12 54 
ee much authority—Delegates little au- 
if meet ; , s —74 —.15 05 —.23 —.01 
te s much time working alone—Spends little 
18, Ko working alone E Se aw 
i. pawativistic—Positive 72 =.16 —.51 oo =20 
ENR great variety of activities, noise etc.— g 
56. Aines very orderly — 8 —.06 01 03 —.26 
21, Le iy verbal—Little verbal behavior 06 80 —.06 35 22 
ere achievement motivation—High achieve- i; 
A Tomes SOD ENE 8 os 
ow affiliation motivation—High affiliation 
5 motivation 87 o4 —18 —26 —.O0l 
B aan recognition motivation—High recognition 
i ie ivation —.11 —.71 — 02 =.12 —.29 
£ Neuroticism—High ego strength 43 —02 —76 —.18 01 


Note.— 
-—Boldface values indicate variables used in assigning factor scores to teachers. 


Was well ; 
whose a Mustrated in the case of one teacher 
Fiete remarks might well have been inter- 
which nied AEN observer as hostile but 
in this y cl ildren obviously did not interpret 
additional a) This latter factor introduced an 
which Pa acon into the Q sort situation 
Biccedi: ikely to lower the reliability of the 
In = but it seemed to be justified. 
tratinent to achieve a more parsimonious 
analysis of these variables a centroid factor 
for the Po varimax rotation was performed 
rotated rst sample of teachers (W = 77). The 
analyst matrix is shown in Table 1. This 
ollo z resulted in five factors labeled as 
WS: 


1. Cold, controlling versus warm, permissive 
2. Vigorous, dynamic versus dull, quiet 

3. Insecure, anxious versus confident 

4. Spends much time alone versus little time 


alone 
5. Much academic activity versus little aca- 


demic emphasis 


These dimensions are quite similar to 
those of Ryans (1960). It is interesting 
to note that Affiliation and Control do 
not emerge as separate dimensions, a 
result supported by the correlation of the 
ratings on these variables. As viewed by 


26 WALLEN, Travers, REID, AND WODTKE 


the observers there is a distinct tendency 
for the controlling teacher to be cold 
and aloof though there are exceptions. 
Each teacher was assigned a score on 
each factor which was the sum of the Q 
sort ratings on the dimensions having 
highest loading on the factors. These 
loadings are in boldface type in Table 1. 
Intercorrelations among the Q sort 
factors are shown in Table 2. The first 
point to be noted is that there are sub- 
stantial correlations between certain of 
the factor scores. Thus, in spite of the 
fact that the factor analysis maintained 
orthogonal factors, these independent 
factors tend in some cases, to produce 
correlated factor scores as applied to this 
sample of teachers. The nature of the 
correlations among factor scores varies 
considerably from Sample 1 to Sample 2. 
Thus, for Sample 1 the correlation be- 
tween scores on Factors 1 and 3 indicates 
that the teacher who was viewed as 
warm and permissive also tended to be 
viewed as nonanxious and emotionally 
stable. The correlation between scores 
on Factors 2 and 5 indicates that teach- 
ers viewed as stimulating appear more 
concerned with school learning as such. 
These correlations, however, are much 


lower in Sample 2. In Sample 2, the 
magnitude of correlations shifts such 
that Factor 1 (warm, permissive versus 
cold, controlling) scores correlate more 
highly with Factor 4 (little time alone) 
scores than Factor 3 (ego strength) 
scores. 

Since there are no other criteria (other 
than ratings) which are logically related 
to Factors 2 and 3, the possibility exists 
that these factors themselves as well as 
subsequent factor scores reflect a bias 
common to the observers rather than a 
description of behavior. Factors 1 and 5 
are on more solid ground since they are 
related to an objective criterion—teacher 
statements—as will be discussed next. 

Intercorrelations among the various 
measures of classroom behavior are 
shown in Table 3. Those instances in 
which the correlation was nonsignificant 
(.05 level) for both samples have been 
omitted.* The major finding is that the 
measures of Control and Affiliation are 


2 Two-tailed tests are reported throughout 
for ease of communication although one-tailed 
tests are justified in many instances wherein a 
Positive correlation between different measures 
of the same characteristic or between a measure 
of need and its hypothesized counterpart in 
behavior were, of course, predicted. 


TABLE 2 


INTERCORRELATIONS AMONG F, 


ACTOR SCORES FOR THE Two S 


AMPLES OF TEACHERS 


Factor 


i. Warm, permissive—Cold, controlling 


Quiet, controlled, dull—Stimulating, active 


High ego strength—Low ego strength 


4. Spends much time alone—Little time alone 


an 


Little concern with academic achievement— 
Much concern 


Correlations for Sample 2 are in parentheses 
05. a 


2 3 4 5 
07 624% ie i 
(—.16) ( .34)* ( .62)** ( 
-00 =ni 
(— 04) (—.31)* ( 
13 
C 3025 ( 
12 
t .20) 
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TABLE 3 


CORRELATIONS AMONG MEASURES OF TEACHER BEHAVIOR 


M Teacher statements Rating 
Factor jew fi 
Achieve- Con- Manage. Achieve- Afilia- Recoge Con- 
o ment trol ment ment tion nition trol 
1. Warm—Coid S E i es)" 
: 3 s 
2. Quiet—Stimulating 
3. High—Low ego strength 
+. Much—Little time alone 
5. Little—M 
¥ Much academi 
emphasis a niii —.25° 
(—.09) 


Tea 
acher statements Achievement 


Tea 
cacher statements Affiliation 
Teacher statements Control 


Tes i 
vacher statements Management 


S 
Sample 2 values are in parenthesi 
01. 


hee in a consistent fashion across the 
tween Nt is The correlations be- 
thërati $ teacher statement measure and 
tion ony, are .33 and (.41)* for Affilia- 
tory = fo and (.28) for Control. Fac- 
Aiiiliatio ich is a combination of the 
relates ee Control dimensions cor- 
statement maa tany with the teacher 
a eae a n Zad 
tion; ae rating measures of Affilia- 
statement eee (—.50) with the teacher 
(—.62) wi ontrol score; and —.54 and 
trol. ‘Ty with rating measures of Con- 
the ne ai results are consistent with 
tion and i correlation between Affilia- 

The ontrol as reported previously. 
Butera correlations between 
Pps a and ratings are, in general, 
mind ih ed though it must be kept in 
pendent; these do not constitute inde- 
both are — E techniques since 
of teach ased on observer classifications 
—_Sacher characteristics. The correla- 


3 
a first value pertains to Sample 1. The 
ple 2 value, in parentheses, pertains to Sam- 


tions which are in accord with expecta- 
tions are: —.77 and (—.55) between 
Factor 2 (dull) and rating on Recogni- 
tion: .31 and (.63) between Factor 4 
(little time spent alone) and rating on 
Affiliation; —.73 and (—.60) between 
Factor 5 (nonachievement oriented) and 
rating on Achievement. The correlations 
between ratings on Control and Affilia- 
tion with Factor 3 (high ego strength) 
are —.34 and .38 for Sample 1 and are 
consistent with other relationships found 
between these variables. The correla- 
tions between Factor 2 (dull) and rat- 
ings on Achievement and Control (—.46 
and —.45, respectively, for Sample 1) 
are to be expected since this factor is 
apparently primarily a “recognition” fac- 
tor and the correlations among ratings on 
Achievement, Recognition, and Control 
are all substantial for Sample 1. The 
same explanation applies to the correla- 
tion of —.44 (—.33) and —.34 (—-51) 
between Recognition and Control rat- 
ings and Factor 5 which is essentially an 
“achievement orientation” factor. These 
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correlations differ in Sample 2 since the 
correlations among factors and among 
ratings changed somewhat from Sample 
1 to Sample 2. Thus, in summary, the 
ratings and factors show the internal 
consistency one should expect since they 
are two approaches based on the same 
original information: observer impres- 
sions. 

As mentioned previously the teacher 
statements measures provide support for 
the observational measures of Affiliation 
and Control dimensions and combina- 
tions thereof. With respect to the Recog- 
nition and Achievement dimensions, 
there is less correspondence. The cor- 
relations between teacher statements 
Affiliation and Achievement rating in 
Sample 1, —.45, and between teacher 
statements Management and Recognition 
rating in Sample 2, (.34), are close to 
zero in the other sample. The teacher 
statements Achievement measure pro- 
vides only slight support for the obser- 
vational measures of achievement orien- 
tation since the correlations are .11 and 
(.21) with Achievement rating and —.25 
and (—.09) with Factor 5. 


NEED MEASURE 


The measure of need used was the 
Teacher Preference Schedule (TPS) de- 
veloped by Stern and Masling (1958) .4 
It consists of 100 statements relating di- 
rectly to teaching or to children to which 
the respondent indicates the extent of 
her agreement. In addition to the 10 
needs described by the authors, the test 


* Several other Paper-and-pencil devices were 
used to assess needs including a projective 
device patterned after French’s 


i € (1955) A Test 
of Insight and devices requiring selection of 
preferred ways of responding to classroom sit- 


uations and statement of preferences regarding 
educational objectives. None of these devices 
predicted classroom behavior though the pro- 
jective test has demonstrated considerable 
validity as a predictor of performance in lab- 
oratory studies. 


was scored for Achievement, Affiliation, 
Control, and Recognition need according 
to keys prepared by the present writers. 
Split-half reliabilities of these measures 
are not reported by the authors; how- 
ever, they were computed in the present 
study for the two most promising needs 
(as discussed below) with the following 
results: Control need=.80 and Affilia- 
tion need=.64, Inasmuch as we were 
primarily interested in the needs of 
Achievement, Affiliation, Control, and 
Recognition and since these scores 
proved most predictive of teacher be- 
havior, subsequent discussion is re- 
stricted to these scores. 

Intercorrelations among these need 
scores are shown in Table 4 and indi- 
cate that while the scores are quite ùn- 
related for Sample 1, the Achievement 
Score correlates quite substantially with 
the Affiliation and Recognition scores in 
Sample 2. The only correlation which is 
consistent for both samples is that be- 
tween Affiliation and Recognition. 


RELATIONSHIPS BETWEEN NEED SCORES 
AND BEHAVIOR 

The results are shown in Table 5. 

Those instances in which the correla- 

tion was nonsignificant (.05 level) for 

both samples have, again, been omitted. 


TABLE 4 


CORRELATIONS AMONG SCORES ON THE TEACHER 
PREFERENCE SCHEDULE 


TPS Afilia- Reog- a oo] 
tion nition — Contre 
aT pn n cc A 
Achievement 05 .19 — isi" 
(.48)** ( 52)** ( 20) 
Affiliation 39** —.07 
(.60)** (—.22) 
Recognition at 
(—.15) 
kA anple 2 values are in parentheses. 
*p=.01. 


TABLE 5 
RELATIONSHIPS BETWEEN TPS AND Measures OF CLASSROOM BEHAVIOR 


(Factor scores, teacher statements, and ratings) 


Factor score 


Teacher statements 


Ach. 


—.18 


—.17 
(—.34)* 


3444 
(—.20) 


30)* 


— .08 


Achievement 


( 40)** 


(.34)* 


34) * 
— 02 


( 


18 
(.35)* 


Affiliation 


42) ** 
.15 


( 


(—.01) 


— 38** 


22* 


Recognition 
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Ble 


39)* 
— 38** 
(—.39)* 


( 


— Agee 
(—.47)** 


Control 


.30)* 


( 


A 
5 


Note.—Those values which were predicted and are in t 


** = 01. 


The primary result is the finding that 
the measures of controlling behavior are 
consistently and quite highly related to 
the appropriate scales of TPS. The most 
impressive relationships are between the 
Control need on TPS and the behavior 
rating for Control, .51 and (.30), and 
the teacher statements Control, .34 and 
(.29). In view of the negative correla- 
tion between Control rating and Affilia- 
tion rating, a negative correlation be- 
tween Control need on TPS and 
Affiliation rating would be expected and 
does in fact occur, —.38 and (—.39). 
‘The relationship between Control on TPS 
and the factor scores is consistent with 
the preceding results in that both Fac- 
tors 1 (warm, permissive) and 3 (con- 
fident), the scores of which are corre- 
lated one with the other, correlate 
significantly and negatively as expected 
with Control need on TPS. To summa- 
rize, the Control score on TPS appears to 
be a promising predictor of the principal 
dimension of teacher behavior which 
emerges from our study—i.e., warm, per- 
missive versus cold, controlling. One 
should perhaps, emphasize again at this 
point that this dimension results from 
classroom observation measures. The 
best conclusion is that TPS Control score 
predicts controlling behavior on the part 
of the teacher and that, as viewed by the 
researchers, controlling behavior is 
highly related to lack of warmth and to 
a lesser degree to lack of confidence ‘or 
the part of the teacher. 

In general the remaining relationships 
support the above discussion in that TPS 
measures are related as expected to be- 
havior measures. Those significant cor- 
relations which were in the predicted 
directions are underlined. Thus, the 
Affiliation score on TPS correlates posi- 
tively, as expected, with the Affiliation 
rating. It does not, however, correlate 
as expected with the teacher statements 


Affiliation score. 
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With respect to the remaining meas- 
ures of teacher behavior: Achievement 
orientation (rating, factor, and verbal 
statements), Recognition (rating and 
factor) and teacher statements Manage- 
ment, few TPS measures relate signifi- 
cantly to them nor does a meaningful 
pattern emerge. There are no consistent 
predictors either for teacher statements 
Achievement scores or for Recognition 
(factor and rating) or for teacher state- 
ments Management scores. It is impor- 
tant to note that correlations which were 
expected to be low and nonsignificant 
are, in general, in accord with expecta- 
tion. 

It should be noted that the Achieve- 
ment dimension appears much more pre- 
dictable for Sample 2 than for Sample 1. 
Whereas there is no systematic pattern 
of relationships in Sample 1, in Sample 2 
both TPS Achievement and Affiliation 
scores are related to the Achievement 
Factor 5 and to Achievement ratings, 
such that high achievement behavior is 
related to low Affiliation and low 
Achievement need as measured by TPS. 
The negative correlation with TPS 
Achievement is contrary to expectation 
but consistent with the positive correla- 
tion between TPS Achievement and TPS 
Affiliation for this sample. 

It is also of interest that Factor 4 
(tle time spent alone) is correlated, 
as would be expected, with TPS Affilia- 
tion in Sample 2. It is also correlated 
with TPS Achievement and Recognition 
scores and, negatively, wtih the Control 
score. The former two correlations are 
expected since there exist substantial 
correlations among TPS scores for this 
sample. The relationship with Control 
cannot be explained on this basis but is 
consistent with expectation. Since these 
results obtain only for Sample 2, they 
are merely suggestive. 


Discussion 


These results seem quite encouraging 
with respect to the predictability of at 
least some aspects of teacher behavior 
in the classroom. It was disappointing 
to find so little predictability for the 
Achievement or academic emphasis di- 
mension. Perhaps this indicates that 
this aspect of classroom teacher behavior 
is less a function of teacher personality 
than the Control-Affiliation aspect; per- 
haps being more affected by external 
pressures such as attitudes of the princi- 
pal or immediate situational conditions. 

It is of considerable interest to note 
that the only effective predictor of 
teacher behavior in the study was a rela- 
tively straightforward questionnaire. As 
noted earlier, several other instruments 
were used with no success including a 
projective test which had shown con- 
siderable validity in several “laboratory” 
studies conducted by us and whose 
predecessors have a generally, though 
not unequivocally, favorable record (At- 
kinson, 1958; Travers, Wallen, Reid, & 
Wodtke, 1961). It may be of value to 
consider possible explanations for this. 

First, there is the fact that situations 
in which instruments similar to our pro- 
jective test of needs have been used most 
successfully have been ones in which the 
cues related to motive arousal have been 
under the control of the experimenter. 
In addition, the best success has been 
achieved with instruments which have 
been administered also under conditions 
which permit some control over the cues 
present while the instrument was being 
taken. From a theoretical standpoint 
prediction should be best when control 
is exercised over the motive aroused 
both in the testing situation and in the 
criterion situation, Such control gener- 
ally cannot be exercised when projective 
devices are used for making predictions 
in naturally occurring situations. Cer- 
tainly, in the present research, the prac- 
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tical impossibility of maintaining such 
control of both the testing and teaching 
conditions would reduce the possibility 
of making predictions. 
in point may be made in a slightly 
ifferent way. If one desires to predict 
typical performance of a person under 
ies conditions which are familiar to 
om best prediction may very weli 
eck | devices which ask him, in 
Sich ý ow he behaves in such situations. 
inde are the findings of the present 
pcs A sy they are similar to results 
ee ng elsewhere in the literature. 
eh A in fact, be a misnomer to label 
ss easures “needs.” Rather, such 
straps mag perhaps better be viewed 
ee T self-descriptions of prefer- 
cans ehavior, and the like without be- 
soe 1g involved in the supplementary 
‘fie which attach to the term need. 
Por contribution of more subtle de- 
whid pn as projective techniques, 
need oe re to assess dynamic as op- 
Ertard T ehavioral variables, should be 
stima e prediction of behavior under 
the ee conditions which are novel to 
aeS The development of so-called 
pama oe revolves on the 
seed at individuals having differing 
havior rr may exhibit similar be- 
ed as that individuals with similar 
boliviar cture may show very different 
as ten T he value of need assessment, 
chose primarily in predicting behavior 
nma T conditions wherein well es- 
eae ia behaviors are less likely to 
Stu oe a | be noted that laboratory 
h erein projective measures have 
criterion predictive success meet the 
ekteni pa of novelty to a much greater 
kdi an classroom situations as stud- 
Sa this project. 
tern h there is the possibility that 
ations ve take projective tests in situ- 
where ‘ es er than the laboratory oF 
or req ey suspect that the test is given 
sons other than academic ones, 
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may manifest response sets which seri- 
ously detract from the significance of the 
scores. In the present research, evidence 
indicates that the responses of teachers 
to the projective test were different from 
those of students to whom it was ad- 
ministered as part of a general class 
requirement. While the scores of the 
student population showed that the four 
scales had a high degree of independ- 
ence, the scores of the teachers showed 
a high degree of relationship among the 
scales. Several explanations may be sug- 
gested for this phenomenon. One is that 
the teachers may differ from the stu- 
dents by representing a population in 
which there ave relatively highly corre- 
lated needs. Another is that the teach- 
ers may differ one from another in a 
variable which might be described as 
imagery fluency. Thus some teachers 
may obtain low scores on this device be- 
cause they fail to respond as profusely 
to any of the cues provided by the 
items while others may respond pro- 
fusely to all of the items. 

The problems raised here are persist- 
ent in the use of projective devices and 
are not unique to this study. While 
most measuring instruments can be used 
in situations other than those in which 
they have been demonstrated to have 
validity, this generalization may not 
apply to projective devices because of 
their extreme sensitivity to testing 


conditions. 
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FAMILIAL CORRELATES OF ORIENTATION 
TOWARD FUTURE EMPLOYMENT AMONG 
COLLEGE WOMEN’ 


ALBERTA ENGVALL SIEGEL ? AND ELIZABETH ANN CURTIS ° 
. Pennsylvania State University 


Information obtained from individual interviews with 43 young women, 


a random sample from the population of so 
was coded by 2 independent scalers to yield 


campus of a large university, 


measures of the work orientation 0 
socioeconomic status, parents’ 


work orientation, parents’ views on purpose of 
ducation for the daughter. Only 1 of 


families: 


»attitudes toward importance of e! 


these latter characteristics—mother’s w 
be significantly correlated with wor! 
they intended to marry and to wor! 
may have operated to depress observed correlations. 


phomore women on the 


í the Ss and 5 characteristics of their 


educational level, mother’s 
college, and parents’ 


ork orientation—was found to 


k orientation in Ss. Most Ss stated 
k. The homogeneity of the sample 


wm 


Pee Study bears on the often-noted 
ne hag between young women’s ex- 
the oni and plans for their future, on 
facin ns and, and the actual likelihoods 
orn . em, on the other. Whereas adult 
So are increasingly entering the na- 
said ips force, young women are 
emacs e continuing to focus their ex- 
an ions for the future upon home and 
to ae The purpose of this study was 
pt the extent to which college 
Sogn are oriented toward future em- 
oat and to determine the relation 
work and students’ orientation toward 
famili certain characteristics of their 
ies. 
the mulated under the assumption that 
validity of individual interview re- 


Spo: å 
Ponses, carefully coded by well-trained 
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judges, is much higher than the validity 
of more easily obtained responses to a 
written questionnaire, this study stands 
in contrast to previous ones with similar 
purposes in its use of individual open- 
end interviews. 


* METHOD 


Subjects 


Subjects were native-born white women en- 
rolled in the sophomore year on the Uni- 
versity Park campus of Pennsylvania State 
University, a large land-grant institution, 90% 
of whose undergraduates are residents of 
Pennsylvania, the great majority of them from 
the upper one-fifth of the high school gradu- 
ating class. 

A random sample of 46 subjects was drawn 
from a list of all third and fourth semestc. 
women on the campus during the spring se- 
mester of 1961. Those selected were contacted 
by letter, and then by telephone call and a 
confirming letter. Subject response was excel- 
lent: 44 of the subjects completed the inter- 
view. One of these was dropped from the 
study because of foreign birth, so results are 
reported for V = 43. 

From the interview data, it was determined 
that the majority of the subjects (8490) were 
19 years old, the remaining few either 18 or 
20. They represented a diversity of major 
curricula, with over one-half enrolled in vari- 
ous education majors (a proportion which is 
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similar to that in the population of sophomore 
omen). 

“The — of subjects oe pe fathers 
working in the top two levels o e seven- 
level S of Hollingshead and Redlich (1958, 
pp. 390-391), and all but 9% had fathers in 
the top three levels. About one-half of the 
fathers were college graduates; only 15% had 
achieved less than high school graduation. Of 
the mothers, only 17% had achieved a college 
education, but an additional 39% had re- 
ceived some education beyond high school 
without attaining a baccalaureate degree. Only 
11% of the mothers had achieved less than 
high school graduation. All but 14% of the 
subjects came from homes in which both 
parents were living. The homes of 54% were 
in suburbs; while 30% were in towns, 9% 
were in rural areas, and 7% were in cities. 


Interview 


Procedure. All interviews were conducted 
in a small conference room by the same per- 
son, a young women. Interviews consisted, 
first, of a series of open-end questions con- 
cerning the subject’s purpose in seeking a 
college education and her plans for the years 
after college, and, second, of a longer series 
of open-end questions concerning family back- 
ground and parents’ attitudes toward educa- 
tion. Interviews typically required 30 minutes, 

Coding. Responses were coded directly from 
tape recordings, on the basis of codes devised 
in advance through pilot work, 

Since the purpose was to relate work orien- 
tation of the subjects to certain family back- 
ground variables, it was necessary to obtain 


on, using scales to 
B listened only to 
the later series of questions, coding for the 
other variables in ignorance of the subject’s 
responses relevant to work orientation, 

To check the reliability of the codes, a third 
coder, C, was employed, who worked with a 
sample of 20 of the tapes (every second case). 
Coder C initially coded responses to the second 
series of questions, thereby checking the re- 
liability of B, and then coded the responses to 
the first series, thereby checking the reliability 
of A. 

In general, good intercoder agreement was 
obtained. For the 11 nominal (categorical) 
codes, the median reliability was 90% agree- 


ment, with a range from 70% to 100% agrec- 
ment. For the 9 ordinal (rating scale) codes, 
the median reliability was rho = .93, with a 
range from rho = .64 to rho = .99. (For only 
2 of the 9 ordinal codes did reliability fall be- 
low rho = 81.) 


Scales 


Work orientation of subjects. The initial 
questions in the interview related to the sub- 
ject’s plans, expectations, and hopes concerning 
employment. These were arranged in an order 
so that the initial ones did not arouse the 
salience of the work versus home issue, while 
the later ones probed increasingly `n this some- 
times sensitive area. Responses to each series, 
described in order below, were coded as work 
oriented or not work oriented. 

1. The subject was asked to identify her 
major field of study and to state the purpose 
of that curriculum. A response was coded work 
oriented if the subject described her curriculum 
in terms of preparation for an occupation. 

2. The subject was then asked to state the 
role she thought her college education would 
play in her future, and to sketch her plans after 
leaving college. A response was coded work 
oriented if the subject mentioned employment 
in her plans for the near future. 

3. The topic of marriage was then intro- 
duced explicitly: “When you think of the 
future, how does marriage figure in your 
plans?” A response was coded work oriented 
if the subject Stated that she intended to con- 
tinue working after marriage. 

4. The possibility that a women might wish 
to stop working after Marriage was then sug- 
gested, and the subject was asked how she felt 
about a woman's working after she had chil- 
dren. A response was coded work oriented if 
the subject stated she wanted to work through- 
out her Marriage, or if she wanted to work 
until children were born and then to return to 
work when they entered school. 

5. Finally, the subject was asked “Suppose 
you were thinking about marrying a particular 
man, and you realized that if you married this 
man it would be impossible for you to continue 
to work. Would you marry this man?” This 
question was deliberately phrased so that the 
nature of the husband-work conflict was am- 
biguous. Not a single subject stated that she 
would give up the man in order to retain her 
freedom to work, so a response was code 
work oriented if the subject’s reply was equiv- 
ocal, eg., indicated that such a choice coul 
be avoided, 


6. To supplement the foregoing codes. the 
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Interviewer (who was also later Coder A) 
made an overall assessment of each subject’s 
Motivation for work achievement, using the 
entire content of the interview and her im- 
Pressions as interviewer and coder. She used 
a five-point scale ranging from “strongly ori- 
ented to work, ambitious, interested in achieve- 
ment through work” to “not ateall oriented to 
work; work is not important to self satisfac- 
tion.” The subjects who fell at the first three 
levels of the scale were called work oriented. 
From the six codes which have been de- 
tibe, an overall index of work orientation 
way obtained, consisting of the sum of the 
bicas scores. With a possible range from 
a 17 (love scores reflecting strong work ori- 
tation), obtained scores ranged from 7 to 16, 
with a median of 10, 
ene background. The index for each 
Ween Socioeconomic background was a 
cates ted pus of her scores on father’s edu- 
Wel l and father’s occupation, based on the 
A s derived by Hollingshead and Redlich 
58, pp. 390-397), 
lep milari, an index of parent’s educational 
leye Was the sum of scores on the seven- 
fathe Codes for mother’s educational level and 
R er's educational level (Hollingshead & 
€dlich, 1948, p. 391). 
ee an index of mother’s work orientation, 
the S were used to a series of questions about 
mana eis work history and attitude to- 
ap 9 Working. First, the subject was asked 
40% your mother working now?” Just over 
t ia or the replies were affirmative. Second, 
Side t ject was asked about her mother’s atti- 
ia Aea work—whether she would prefer 
employ or not to, irrespective of her present 
x no aeni The subjects indicated that 60% 
ie ther preferred working. Third, the 
Mother’ was queried in detail about her 
each rs work history, and from the replies 
Whetien con was categorized according to 
els er or not she had a consistent history of 
Thoth, a working mother. Only 21% of the 
of havin Were “working mothers” in the sense 
childr ìng worked fairly consistently after their 
Ben were born or after they entered school. 
coded » the nature of the mother’s work was 
hie the purposes of the index of 
Work rs work orientation, the professional 
ers (36%) and the white-collar workers 
mie Were grouped together as presumably 
ili cette ce oriented toward work than the 
tion of a workers (23%). Fifth, an indica- 
taken Fs e mother’s attitude toward work was 
“What fie the subject’s reply to the question 
of col] oes your mother think is the purpose 
ege for a girl?” Replies were categorized 
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according to whether or not the mother 
stressed preparation for an occupation. 

The index of mother’s work orientation was 
the sum of the scores on the five codes just 
described. Theoretically, scores could range 
from 5 to 10, the lowest score going to a sub- 
ject’s mother who was working at the time of 
the study, preferred to work, had a consistent 
history of being a working mother, had been 
employed in either professional or white-col- 
lar work, and stressed occupational prepara- 
tion in her views en the purpose of college for 
the subject. The actual range was from 5 to 
10, with a median of 7.5 and a decile range 
from 6 to 8.5. 

For an index of parent’s views on the pur- 
pose of college, responses were examined to the 
question “What does your father feel is the 
purpose of college for a girl?” and to the same 
question regarding the mother’s opinion. Each 
response was coded according to whether the 
parent included vocational preparation among 
the purposes of college, which was the case for 
about two-thirds of the fathers and just over 
one-half of the mothers. 

The index of parents’ attitudes toward im- 
portance of education for the daughter was 
based on the subject’s replies to questions about 
her parents’ attitudes toward early marriage 
and about their views of the relative impor- 
tance of education for boys and for girls. Theo- 
retically scores on this index could range from 
3 to 13, the lower score representing a subject 
whose father and mother both strongly oppose 
early marriage and who consider education 
more important for a girl than a boy. In the 
sample, scores ranged from 4 to 11 (no parents 
considered education more important for a girl 
than for a boy), with a median of 5 and a 
decile range from 5 to 8. 


RESULTS 


The prevalence of orientation towarc 
work among the subjects is indicated by 
the data displayed in Table 1. By five 
of the six criteria, 70% or more of the 
subjects were oriented toward future em- 
ployment. For only a small minority of 
the subjects (14%), however, would 
there be any hesitation if there were a 
choice between marrying a particular 
man and continuing to work. 

Intercorrelations among the six indi- 
vidual codes of work orientation are dis- 
played in Table 2, along with part- 
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TABLE 1 background characteristics: socioeco- 
Work ORIENTATION AS EXHIBITED BY nomic status (rho=.10), parents’ edu- 
RESPONSES TO SEVERAL ISSUES AND cational level (rho=—.02), parents 


AS ASSESSED BY INTERVIEWER views on purpose of college (rho=.01), 


and parents’ attitudes toward impor- 
Pp 


Percent- Percent- tance of education for the daughter (rho 
Measure agework “Bent = 13). There was a significant correla- 
oriented = iented tion between work orientation and the 
— other family background characteristic, 
1. Purpose of major a mother’s work orientation: rho=.35, 
currioulum ue 25 t=2.15, p < .05, two-tailed test (Siegel, 
i a ae id 88 a 12 1290; Bes 202-213), 
3. Marriage and work 70 30 Discussion 
4, Motherhood and work 77 23 
5. Conflict between hus- The descriptive data do not confirm 
band and work 14 86 the widespread observation that young 
6. Interviewer assessment college women are unrealistic about their 
of work motivation 70 30 


futures. Their orientation is not dis- 
crepant from the likelihood that they 
whole correlations between the individ- Will spend large segments of their lives 
ual codes and the index of work orienta- in paid employment. It would be correct 
tion.* to say, however, on the basis of our im- 
The intercorrelations among the in- pressions from the interviews, that their 
dices are displayed in Table 3. The pur- expectations of the future are vague and 
pose of constructing these indices was somewhat stereotyped. Like most col- 
to determine the relation between work lege women today (cf. Newcomer, 1959), 
orientation and five family background the subjects were secure in their expec- 
characteristics, In this sample, there was tations of marrying, and it would seem 
no significant correlation between work further that their views of their own 
orientation and the following four family futures do not extend very vividly be- 
*The reader is reminded that point-biserial yond the period of involvement in child- 
correlation coefficients (7p) tend to be lower Tearing. 
than other familiar correlation coefficients; Hindsight suggests that in place of 
they are not estimates of r, using a single index of work orientation, 


TABLE 2 


INTERCORRELATIONS AMONG MEASURES oF Supyects’ Work ORIENTATION 


Measure Tetrachoric correlations a 
1 2 we 
eee i i P 4 orientation 
1. Purpose of major curriculum — 48 36 = i 
2. Work in plans for near future es 58 a BY —.05 
3. Marriage and work iiss zs = 55 
4. Motherhood and work aa To 45 
5. Conflict between husband and work ‘ 1t 
6. Interviewer assessment of — 43 


work motivation 
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TABLE 3 


INTERCORRELATIONS AMONG InpICES 


(Spearman rank-correlation coefficients) 


- Subject’s work orientation 
- Socioeconomic status 
- Parents’ educational level 


1 

2 

3 

4. Mother's work orientation 

5. Parents’ views on purpose of college 
6 


- Parents’ attitudes toward importance 
of education for the daughter 


2 3 4 5 6 
10 — 02 35* 01 Is 
— (g0)* 06 —.09 —.30 

> 12 -03  —.25 
= (34)* —.01 
— 14 


Note.— i i 
Note.—Correlations which are based in part on common elements a! 


b= 05, two-tailed test. 


pcg have been better to distinguish 
lcs nie expectation of employ- 
epl and aspiration for achievement in 
eos es The impression garnered 
hate the interviews is that most young 
for “i fully expect to work, but that 
oe wr the purpose is not so much to 
ve service through a profession or to 
me petama satisfaction from achieve- 
the hes it is to conform through playing 
fer eminine role now socially defined 
them. 

ear ie five background variables ex- 
tion ed, only the mother’s work orienta- 
seme a found to be correlated with 
hoi ae ay of the subjects. Al- 
nie it is hazardous to attach much 
ene ence to a “significant” finding 
tags ting in the context ofa number of 
aw ones, this correlation 1s of 
the on confirming the general view of 
i eee of the generations through 
the A cation and role modeling within 
noii However, one would have 
deed confidence in this finding, and in- 
ph ai findings which relate a char- 
tics a s of the subject to characteris- 
oncer er parents, if the information 
inda a the parents were obtained 
e 4 ndently. Here we risk, in reverse, 
midh coc error which characterizes so 
research on childrearing, in which 


re shown in parentheses. 


parents are used as informants not only 
on their own characteristics but on those 
of their children as well. 

In part, the generally negative result 
of the search for familial correlates may 
be attributable to the homogeneity of 
the subjects. They were much alike in 
their responses to the items comprising 
the indzx of work orientation (80% fell 
in a five-point range on an index with a 
theoretical range of 11 points) and were 
homogeneous in socioeconomic back- 
ground and parents’ educational level as 
well, Although the scores on the various 
indices were not so homogeneous as to 
render statistical analysis superfluous, 
they were sufficiently so to depress ob- 
served correlations. This may have 
operated in conjunction with the limited 
sample size to mask whatever relatious 
may exist in the population among the 


variables. 
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I M TUDY 
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OF THE LEARNING ABILITIES OF NEGRO 
AND WHITE CHILDREN UNDER FOUR 
CONDITIONS: 
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Cedar Rapids Community School District, Iowa 
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University of Texas 


Object pairs and picture pairs of these same o 
similar or dissimilar sets ‘provided 4 experiment: 


bjects in conceptually 
al conditions for com- 


paring paired-associate learning of 135 Negro Ss with 141 white Ss across 


age levels 5 through 9 years. 


Despite significantly lower Full Scale 


WISC IQs (p < .001), the analysis of variance showed that differences 


in paired-associate learnin: 
disappeared by 9 years of a 


5 years, however, negligibl 
and IQ for both races (.0 
ceptually similar sets was easie: 
most difficult for both races 


Measured differences between Ne- 
groes and whites continues to be a con- 
troversial topic in the psychological and 
educatioral literature. Garrett (1945a, 
1945b, 1947) and more recently Shuey 
(1958) have pointed out the generally 
inferior performance of Negroes on a 
wide assortment of intelligence tests, 
both group and individual. Dreger and 
Miller (1960), in an extensive review of 
psychological differences between Ne- 
groes and whites, while not disagreeing 
ccmpletely with the genetic explanations 
of Garrett and Shuey have stressed 
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Portions of this paper were read at the 
Annual Convention, American Psychological 
Association, New York City, September 1961. 
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officials of the Austin Public School System for 
their cooperation. A special note of thanks is 
due C. L. Moore, Principal of L. L. Campbell 
School, and W. C. Wade, Principal of Becker 
School. Virgie Lee Washington of Greater Mt. 
Zion Nursery School was most helpful in all 
stages of the investigation. 
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g favoring white Ss at younger age levels 
ge (p < .05) with no race difference when the 
d. Race differences in IQ were greatest at 
e correlations were obtained between learning 
94 and .189), Associating object pairs in con- 


st and picture pairs in dissimilar sets 
(p< .001), 


strongly the importance of the psycho- 
cultural environment and the need for 
further cross-cultural research. There 
is little mention in this review of studies 
involving the learning abilities of Ne- 
groes and whites. This is not due to the 
reviewers’ laxity since the typical Negro- 
white study is limited characteristically 
to reports of existing intellectual differ- 
ences without regard to the effect of such 
differences on specific task performance. 

The concern of the present research 
was to compare the abilities of Negro 
and white children on paired-associate 
learning tasks where Previous measure- 
ment had determined that the white 
children had significantly higher IQs. 
However, since the relationship between 
measured intellectual status and learn- 
ing ability is imperfectly understood 
(Sarason & Gladwin, 1958) and since 
paired-associate learning ability does 
not seem to be closely related to intelli- 
gence level (Berkson & Cantor, 1960; 
Eisman, 1958), it was hypothesized that 
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no difference would be found between 
Negro and white children. 


AIETHOD 
Subjects 


e All subjects were enrolled in the public 
A iog] and private kindergartens in Austin, 
ea At the time of the study the schools 
ie ss segregated as a result of neighber- 
pokes E situations rather than school 
Š% ae n attempt was made to select schools 
De it to minimize socioeconomic differences. 
thie’ e these efforts and not unexpectedly for 
an region, of the country, a significant differ- 
i ce in favor of the white children was ob- 
ained. 

E a of the children ranged from 5 
Was pa 9 years. The mean age for the whites 
ems and for the Negroes 7-4. The subjects 
firmer ee selected by ages from lists 
aero by the schools. Each child was first 
Child, stered a Wechsler Intelligence Scale for 
After cn (WISC) using trained examiners. 
dui imately a week, each child was 
havin pie the paired-associate learning task 
one ae aa randomly assigned previously to 
some ih e four experimental conditions. In all 
of the 5 children were tested for this portion 
WISC sees Table 1 provides comparative 
eee ull Scale IQ data for the 275 subjects 
Whites and age level. The superiority of the 
(ae n eeecially at the lowest age level, is 

scussed in detail later. 


Se : . š 
lection of Stimulus Pairs 
rane patis of stimuli were employed for the 
-associate learning task. Each stimulus 
TABLE 1 


Mr 
ee WISC Furr Scare IQs or WHITE AND 
Cuipren py Sex at Five AcE LEVELS 


Age in years 


Subj 7 
jects 5 6 7 8 9 Total 
Whit 
Boys = 141) 
M 
N 108.3 104.2 97,7 105.2 98.5 
ai 19° 22 12 I5 12 80 
Girls 
a 
M 116.5 104.9 97.2 105.8 94.2 
Negro n 7 15 15 12 12 61 
Tory = 134) 
M 
N 83.4 92.6 90.6 98.3 89.5 
E 13 14 12 20 12 71 
Ging 
if 
N 82.5 103.0 90.8 96.5 85.0 
13 12 12 14 12 63 


pair was selected from a different conceptual 
classification involving items which were fa- 
miliar to both groups and assumed to be in- 
formally learned early in the lives of all these 
subjects. Pretesting revealed that young chil- 
dren could sort the 12 stimulus objects into 
6 pairs, based on functional utility or con- 
ceptual similarity, and could, in most cases, 
verbalize the basis for their pairings. 
The six pairs employed were: 


Stimulus , Response 
BANANA ORANGE 
TOOTHBRUSH COMB 

PIFE CIGAR 

DOLL TOY TRUCK 
cuP BOWL 
GLOVE SHOE 


The assumption was that the above pairs 
possess high associative value by virtue of 
conceptual or functional similarity. In order to 
provide item pairs which would require new 
learnings (associations) these Similar pairs were 
rearranged as follows: 


Stimulus Response 
BANANA SHOE 
TOOTHBRUSH ORANGE 
PIPE COMB 

DOLL CIGAR 

cup TOY TRUCK 
GLOVE BOWL 


The assumption underlying the resulting 
Dissimilar condition was that the associative 
values in terms of categorical or functional 
similarity are much lower than in the case 
of the Similar condition. This assumption 
is supported by the findings of Underwood 
and Richardson (1956) with regard to verbal 
associations and concept formation. es 

In order to assess the effect of the availabilit, 
of cue on the learning of the stimulus pairs 
employed, one set was composed of actual ob- 
jects (Concrete) while the other consisted of 
high quality colored 314 X 4⁄4 inch photo- 
graphs (Abstract) of these same objects 
mounted on 5X 7 inch neutral colored card- 
board. Therefore, the labels Concrete and 
Abstract refer to operationally defined stimulus 
characteristics. Combinations of the two sets 
of stimulus pairs (Similar versus Dissimilar) 
and two degrees of cue presence (Concrete 
versus Abstract) were used to establish the 
four experimental conditions—i.e., Similar- 
Concrete, Similar-Abstract, Dissimilar-Con- 
crete, and Dissimilar-Abstract. 
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Design and Procedure 


Stimulus pairs were presented manually for 
all conditions. The stimulus object or picture 
was shown for approximately 5 seconds fol- 
lowed by the response object or picture for 
approximately 3 seconds regardless of the 
correctness of the subject’s response. The 
intertrial interval was approximately 5 seconds. 
Each subject was run for 12 blocks of 6 pair 
presentations with a total of 72 pair presen- 
tations in all. Serial learring effects were 
avoided by randomizing order of pair presen- 
tations across trial blocks. An observer re- 
corded the subject’s response on each trial and 
the total number of correct anticipations in 
the 6 pair presentations for 12 blocks was 
used in the analysis of variance. The 275 sub- 
jects who had been administered the WISC 
previously were randomly assigned to one of 
the four experimental conditioas and given the 
paired-associate learning task appropriate to 
their assignment. From this subject pool 31 
Negro children and 31 white children were 
randomly selected from each of the four con- 
ditions providing 124 white and 124 Negro 
subjects for a race by condition analysis. Since 
analyzing data from such a design furnishes 
no age or race by age information a three-fac- 
tor repeated measurement design was em- 
ployed involving two races, four conditions, 
and five age levels. In order to equalize the 
number of subjects in each cell of this design, 
a proportional analysis using 120 (60 white 
subjects and 60 Negro subjects) was carried 
out. In addition, a race by age analysis of 
measured intelligence for these same 120 sub- 
jects was made in order to compare acquisition 
rate and intellectual level. A correlation analy- 
sis between intelligence and total learning score 


for each race was also computed for the origi- 
nal 275 subjects, 


RESULTS 


The analysis of variance for the 124 
white and 124 Negro subjects under the 
four conditions yielded an F of 81.73 
which, with 3 and 240 degrees of free- 
dom, is significant at the .001 level, Non- 
significant Fs for race and the race by 
condition interaction were obtained, It 
is apparent that, while the conditions 
yielded significantly different rates of 
learning, the two races did not differ in 
this respect nor was any one condition 


significantly more difficult for either 
race. 

The proportional analysis of variance 
for the 120 subjects which supports the 
previous analysis in greater detail is sum- 
marized in Table 2. i 

Again, the four experimental condi- 
tions yielded highly significant differ- 
ences. The significant age effect (p < 
.001) and the race by age interaction 
(p < .05) are graphically illustrated by 
Figures 1 and 2, 

In terms of age trends, the learning 
rate of white children was superior to 
Negro children under the Similar condi- 
tion at the 5- and 6-year-old level (Fig- 
ure 1) for both Concrete and Abstract 
paired-associate presentations. In addi- 
tion, differences may be noted between 
whites and Negroes under the Dissimi- 
lar-Concrete and the Dissimilar-Abstract 
conditions. However, race differences in 
learning ability decreased steadily across 
the age levels studied and were not sig- 
nificant in the summary analysis. This 
is illustrated by comparing the learning 
curves of Figure 1 for the combined 5- 


TABLE 2 


SUMMARY or THE PROPORTIONAL ANALYSIS OF 


VARIANCE OF PAIRED-ASSOCIATE LEARNING OF 
WHITE AND Necro CHILDREN BY AGE 
UNDER Four CONDITIONS 


Source dj MS F 

Between subjects 119 

ace, 1 .13 -770 
Condition 3 soeiess 63.6285577 
Age 4 44445 5.579* 
Race X Condition 3 5.815 +730 
Race X Age 4 20.768 2.607" 
Condition X Age 12 6.633 -833 
Race X Condition X Age 12 7.760 974 
Error (b 80 7.966 
Within subjects 1320 n 
Trials 11 166.916 200.139* 
Trials X Race ll 849 1,018, 
Trials X Condition 33 7.001 8.394** 
Trials X Age 44 865 1.037 
Trials X Race X Condition 33 885 1.061 
Trials X Race X Age 44 1836 1,002 
Trials X Condition X Age 132 525 629 
Trials X Race X Condi- 

tion X Age 132 1.031 1.236 
Error (w) 880 834 

‘otal 1439 
$? < 05 


LEARNING IN NECRO AND WHITE CHILDREN 41 


Ai oo sunaps WHITE 
fo Stans NECRO 
œ=- DIS ABS WHITE 
e=- DIS ABS.NEGRO 


Bb suco mare, 
— Sn counearo 
>= DS CON WHITE 
TIL be con nono 


Tess oeTOS NIE 
ABSTRACT CONDITION 


MEAN NUMBER OF CORRECT ANTICIPATIONS 


VETS Se TOD ONE 
CONCRETE CONDITION 


Fic. 1, Trials in blocks of six 5- and 


6-year-olds. 


7 S-year-olds with the curves in Fig- 
olds a the combined 8- and 9-year- 
fe i ere learning ability differences 
tacs e peared. A further analysis of 
va en at the five age levels in 
= “i mean difference in total learn- 
i is reported in Table 3 which 
mental = greater detail the develop- 
sieni rend differences indicated by the 
bc cant race by age interaction re- 
Tted in Table 2. 
i 1 and 2 also show that learn- 
oat most rapid for both white and 
the Si and 6-year-old children under 
A 1 ar-Concrete condition. This is 
Condition wherein the pairs to be 


os SM CON WHITE | 
—* 5M CON NEGRO 
= DIS CON WHITE 
|= DIS CON NEGRO 


OO SIM ABS WHITE 
J4 — SIM ABS NEGRO 

ee DIS ABS WHITE 
= DIS.ABS NEGRO 


MEAN NUMBER OF CORRECT ANTICIPATIONS 


Tes#se7eomnie 
ABSTRACT CONDITION 


re 
fs 3456789102 
ONCRETE CONDITION 


F Š 
1G. 2. Trials in blocks of six 8- and 
9-year-olds. 


TABLE 3 
Mean oF TOTAL LEARNING SCORES AT FIVE 
AcE LEVELS 
Age level White Negro è 
M 48.92 38.25 10.67** 
5 
N 12 12 
M 56.17 50.08 3.73%* 
6 
N 12 12 
M 52.67 56.42 —2.30* 
7 
N 12 12 
M 54.16 56.42 —1.39 
S 
N 12 12 
M 50.33 53.25 —1.79 
9 
N 12 12 
Note.—Based on proportional analysis of variance. 
*p < 05. 
**p < Ol. 


associated were categorically similar and 
cue presence was maximized, The rate 
of acquisition under the Similar-Abstract 
condition was almost as rapid for both 
groups as under the Similar-Concrete 
condition. Cue reduction, regardless of 
race, does not exert a differential effect 
on the learning of conceptually similar 


However, the effect of pair dis- 


pairs. 
ning rates. 


similarity was to lower lear 
This was more pronounced under the 
Dissimilar-Abstract condition than w> 
der the Dissimilar-Concrete condition 
and was true for both races. It appears, 
then, that cue reduction has a significant 
effect on acquisition rate when the pairs 
to be associated involved new learning 
as was the case under the Dissimilar 
condition. 

In general, most of the between-sub- 
jects and within-subjects interactions 
were nonsignificant leaving “pure” main 
effects to be studied. The significant 
trials by condition interaction is clearly 
seen in a comparison of the learning 
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TABLE 4 


CORRELATION or WISC IQs witu TOTAL 
LEARNING SCORE 


Perform- Full 


Race Verbal aa Scale 
White (N = 141) 033 127 -094 
Negro (N = 134) 117 .204* .189* 


* Reliably different from O at ‘the .05 level of con- 
fidence. 


curves in Figures 1 and 2 where acquisi- 
tion rate differs depending upon the ex- 
perimental treatment under considera- 
tion. 

In order to determine the relationship 
between total learning score and intel- 
lectual level a comprehensive correla- 
tion analysis was carried out for both 
whites and Negroes. Part of these data 
is reported in Table 4 which indicates 
low but reliable correlations between 


WISC Performance and Full Scale IQs 


with total learning score for Negroes 


only. Since very low but reliable corre- 
lations were obtained, a further break- 
down of Verbal, Performance, and Full 
Scale WISC IQs by race and age is 
reported in Table 5. It should be noted 
that the data in Table 5 were based on 
the 120 subjects used in the proportional 
analysis of variance of Table 2. Fur- 


ther, an analysis of variance of WISC 


TABLE 5 
‘MEAN VERBAL, PERFORMANCE, 


WISC IQs oF tHe 120 Sus 
AGE LEVELS USED IN THE 


AND FULL SCALE 
JECTS AT Five 


PROPORTIONAL 
ANALYSIS oF VARIANCE 
= 
Age in years 
WISC IQ 5 7 F 3 
=> ey 
White (N = 60) 
Verbal 110.75 104.75 102.67 102.00 91.33 
Performance 116.33 110.83 98.08 109.58 93.25 
Full Scale 114.67 108.33 100.58 106.08 91.42 
N 12 12 12 12 
y N = 60) 
Neer 87.75 105.50 92.50 99.42 99,17 
Performance 86.92 97.25 89.83 100.00 85.50 
Full Scale 86.00 101.83 90.50 99.50 86.75 
N 12 12 12 n R 


TABLE 6 


SUMMARY ANatysis OF VARIANCE OF FULL 
Scare WISC IQs For THE 120 SUBJECTS 
USED IN THE PROPORTIONAL ANALYSIS 
OF VARIANCE IN TABLE 2 


Source df MS F 
Race 1 3830.700 27.472**** 
Age 4 975.138 6.993000} 
Race X Age 4 588.554 4.221*** 
Cells 9 
Within sub- 

groups (w) 110 139.436 

Total 119 

=r < .005. 

SENG e 


Full Scale IQs for these same 120 sub- 
jects is reported in summary form in 
Table 6. This indicates a highly signifi- 
cant difference in WISC Full Scale 1Q 
in favor of white subjects and significant 
differences across the age levels studied. 
However, the differences were more pro- 
nounced at the 5-year-old level which 
may partially account for the race by 
age interaction in view of the low (but 
reliable) correlation obtained between 
total learning and intelligence level. It 
is doubtful, however, if this is the main 
factor in the race by age interaction. 


Discussion 


The lack of previous studies of a 
similar nature produces some difficulty 
in the evaluation of the findings of this 
Study. It is not the purpose of this dis- 
cussion to emphasize the race differences 
obtained in measured intelligence, The 
data indicate the limitation of measured 
intelligence in predicting performance 
under conditions where new learning is 
to take place. In the case of this study, 
the procedure and design suggest 2 
variety of fruitful ways of studying fac- 
tors which may have a significant effect 
on the acquisition of new learning. This 
is an important consideration in studies 
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between races or between groups. The 
results provide developmental support. 
however, for a hypothesis of no differ- 
ence in learning ability between the 
groups studied under the four experi- 
mental conditions. 

Specifically, the results" suggest that 
young Negro children have more diffi- 
re than young white children in learn- 
a associations, especially when 
t reduced by using photographs 
discre an actual objects. The greatest 
28 ‘ancy in Full Scale IQ (about 
Hee existed at the 5-year-old level. 
aas Gi in view of the decreasing dif- 
erica etween races in learning ability 
it of ope levels, and in spite of continu- 
me! Pat a differences in intelligence, 
toil a low correlations between IQ and 
ees aie score, it seems improbable 
explai ellectual differences alone could 
Foe n the superior learning of the 
tion R sar subjects. Some considera- 
aet ue, therefore, for environmental 

rs. 
ie 5-year-old and some of the 
aun Old subjects were obtained from 
rae | schools. Public school kinder- 
ore per se did not exist and a child 
eiel e age 6 by September 1 of the 
= oy to enter first grade. As far 
poke sed school attendance goes, the 
ose tae of Negro children attend 
Syel e mother works. The Negro 
settin children were taken from a 
child oc by a church with over 120 
h ranging in ages from 3 through 
than = were cared for all day in less 
tea hap circumstances. In con- 
he ‘hoa, white children were not for 
ers, Wh part children of working moth- 
sendin = ig their parents’ reasons for 
cilities į em to nursery school, the fa- 
staff w n terms of physical plant and 
calvet ere excellent. The children re- 
Such RAA informal school training 
letters Theis to write numbers and 
. e implication here is that the 
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environment of the 5-year-old Negro 
children was not as stimulating towards 
new learning situations as that of the 
whites. There is also the added implica- 
tion that, in terms of socioeconomic dif- 
ference, the Negro children at the 5- 
year-old level were much lower than the 
whites. In terms of our overall sample 
of Negro and whites, the Negroes were 
also of lower socioeconomic status. This 
is, of course, a problem in comparing 
racial groups. It is virtually impossible 
to equate Negroes and whites on the 
basis of socioeconomic status. Standard 
of living, steadiness of employment, and 
number of persons in the family working 
all complicate the estimate of economic 
status. 

Some comment is due also concerning 
the older Negro children and their public 
school facilities. They came from a 
school which had a very adequate physi- 
cal plant, a good lunch program, and a 
dedicated, well-trained group of teachers. 
This school was certainly the equal of 
that of our older white children. 
Whether these factors really contributed 
to the gradual erasing of differences in 
learning ability with increasing age can- 
not be answered unequivocally, but they 
should at least be pointed out. A com- 
bination of environmental factors may 
well have contributed to the compara- 
tively poor overall learning of the 
younger Negro children. At any rate, 
there is little to be gained by falli-e 
back on a genetic explanation inasmuch 
as these too cannot be separated from 
environmental conditions. What is im- 
portant to note is the developmental sup- 
port obtained in this study for no differ- 
ences in overall learning with increasing 
age of our subjects. 

There is a certain timeliness in the re- 
sults of the present research. As new edu- 
cational opportunities are opened for the 
Negro child in the United States, edu- 


cators will be challenged to find meth- 
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ods whereby the optimum conditions for 
learning can be found and applied. The 
advent of integration has already pro- 
duced a great many problems concerned 
with the learning and motivation of 
minority groups, especially Negroes. 
Our findings of no overall race differ- 
ences in learning ability should not be 
minimized. They suggest that educators 
should exercise great caution in inferring 
learning ability from measured intellec- 
tual level alone. The developmental 
study of specific learning abilities of 
Negroes and whites could provide a 
more effective basis for the psychological 
and educational decisions that inevitably 
will have to be made by tnose who bear 
the responsibility of discovering and im- 
plementing the conditions for the maxi- 
mum development of human potential. 
One study does not in itself prove any- 
thing definitive, especialiy in an area 
that has been replete with charges and 
counter-charges in the past. Further 
research, including possible replication 
of the present study, is indicated. 
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STUDENTS’ THOUGHTS DURING CLASS: 
A CRITERION FOR EDUCATIONAL RESEARCH? 


LAURENCE SIEGEL, LILA CORKLAND SIEGEL, PATRICK J. CAPRETTA, 


REGINALD L. JONES, axo HOWARD BERKOWITZ 


Miami University, Oxford, Ohio 
Relevance of student thinking during class presentations is proposed as a 
relatively sensitive and uncontaminated criterion for educational research. 
Reports of thinking were evoked by modifying the stimulated recall tech- 
nique using video tape and group administration. These reports were 
independently classified along a continuum of “thinking relevance” by 


pairs of ju 


numerical weights determined by a pa 


dges, and the resultant classifications were transformed to 


jred-cumparisons analysis. Reli- 


ability and validity of the stimulated recall procedure were evaluated 


across lectures (n=3) and 


“critical stops” within lectures (n=12). 


The median interrater reliability for critical stops was 58. Validity 


against an independent meas 
at least 3 trials reflecting vV: 
recommended. 


Of all the problems besetting psycho- 
educational research, the criterion prob- 
lem is certainly one of gravest im- 
portance. The search for appropriate 
research criteria has often had the bene- 
ficial effect of focusing the attention of 
both investigator and teacher upon de- 
sired instructional outcomes. These out- 
comes are then reflected in the structure 
of course examinations used to assess 
what students have learned. Occasion- 
ally, course examinations are supple- 
mented with instruments designed to 
measure such less tangible or more ele- 
gant objectives as attitudinal change and 
critical thinking. Regardless of their 
nature, the overwhelming emphasis 1n 
developing criteria for educational re- 
search is upon instruments administered 
at or very near the completion of the 
course. 

Such postcourse criterion measures 
may suffer considerable contamination in 
higher educational settings. The investi- 


ed herein was a by- 
ly of the Instructional 
nt from the Office 
Department of 


1The research report 
Product of a larger stud) 
Gestalt supported by a gra 
of Education, United States 
Health, Education, and Welfare. 


ure of student learning was .61. The use of 
ariations in student moed and interest is 
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gator typically wishes to evaluate the 
effectiveness of some instructional pro- 
cedure from student performance on the 
final examination. Realistically, how- 
ever, final examination performance re- 
flects a variety of variables other than 
the ones under study. To cite an extreme 
instance of such criterion contamination, 
it is quite possible for students to earn 
high final examination scores without 
ever attending a class meeting. This is 
so because they have access to sources 
of information other than face-to-face 
contact with the instructor: textbooks, 
and comprehensive notes taken by a 
friend who does attend class are but two 
such sources. P 

Furthermore, although a final exami- 
nation may be carefully structured in 
accord with instructional objectives, it 
may lack sensitivity as a research cri- 
terion. This would be the case, for ex- 
ample, when the effects of the independ- 
ent variable are cumulative and gather 
strength throughout the semester. Since 
postcourse examination scores typically 
reflect learning throughout the entire 
course when the independent variable 
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effects have been both weak and strong, 
such examinations have a tendency to 
mask cumulative effects (Siegel, 1960). 

These two defects of postcourse ex- 
aminations as research criteria, contami- 
nation and lack of sensitivity, suggest 
the importance of an entirely different 
kind of criterion. Certain types of in- 
vestigations could be enhanced by utiliz- 
ing an immediate rather than a delayed 
criterion measure, reflecting the impact 
of independent variables in situ and 
thereby free from contamination by 
extraneous factors. 

One such criterion, students’ in-class 
thought processes, has been suggested 
and used by Bloom (1953). He tabu- 
lated categories of student thinking dur- 
ing class periods in an attempt to make 
a diagnostic assessment of the relative 
strengths and weaknesses of lecture 
versus discussion presentations of sub- 
ject matter. The technique for evoking 
records of student thinking is termed 
stimulated recall. The entire class period 
was recorded on audio tape. These tapes 
were subsequently played during indi- 
vidual interviews with students within 
24 hours after the original class period. 
The tape was stopped at “critical points” 
and the interviewee was asked to at- 
tempt to relive the original experience 
and recall what he was thinking during 
the stimulus lecture or discussion. 

The stimulated recall technique de- 

` scribed above was suitable for Bloom’s 
purpose but lacked the refinements re- 
quired of criterion instruments. It 
yielded percentage summaries of student 
thoughts assigned in terms of a classifica- 
tory scheme rather than scores along 
some kind of continuum of student 
thinking. The present paper is con- 
cerned with a modification of the gen- 
eral technique of stimulated recall and 
summarizes evaluative data concerning 
its usefulness as a research criterion. 


Problem 


Stimulating recall by audio tape with 
delayed playback to evoke a record of 
thinking during the original classroom 
presentation suffers from at least three 
major difficulties. First, the period of 
delay (up to a maximum of 24 hours) 
between the initial presentation and 
playback may increase the likelihood 
that respondents will forget or suppress 
the thoughts they experienced during the 
original presentation. Second, audio tape 
reproduces only a portion of the original 
classroom experience. To the extent that 
cues in addition to auditory ones could 
be introduced to stimulate recall, the 
resultant memory ought to be more 
complete. Finally, the technique of cql- 
lecting data from individual student 
interviews is obviously laborious. 

In order to determine whether these 
three difficulties could be circumvented, 
we employed a technique whereby (a) 
stimulated recall trials were conducted 
almost immediately following the origi- 
nal presentation, (b) the original pres- 
entation was recorded on video tape and 
students observed the playback from the 
Same seats in the same classroom en- 
vironment as the original presentation, 
(c) data were simultaneously collected 
in written form from the entire group of 
students enrolled in the course. 

The basic problem was to evaluate the 
utility of stimulated recall trials thus 
conducted for providing a meaningful 
criterion of student thinking in situ. 
This evaluation required a series of in- 
vestigations to (a) design a scoring sys- 
tem reflecting relevance of thinking, (b) 
ascertain the reliability with which rat- 
ers could convert these written records 
of thinking to the numerical scale of 
relevance, (c) determine the consistency 
of students’ stimulated recall scores 
across trials encompassing different sub- 
ject matter presentations on different 
days, and (d) estimate the validity of 
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the scores derived from the stimulated 
recall technique. 


METHOD 
Subjects 


These investigations were eonducted in four 
viewing sections of the televised course Foun- 
dations of Human Behavior offered for credit 
to students on the Miami University campus. 
These sections, each consisting of approxi- 
mately 60 students, met for two weekly 50- 
minute TV presentations in a conventional 
classroom equipped with TV receivers. Virtu- 
ally all cê these students were freshmen en- 
rolled in various teacher-training curricula. 


Procedure 


Stimulated recall trials were not attempted 
until aftèr mid-semester. This study was post- 
poned until the second half of the semester 
to enable students to become used to the 
routine of attending a televised class. It was 
feared, were this not done, that some students 
might use stimulated recall trials merely as an 
outlet for expressing personal feelings about 
TV instruction. 

The procedure for conducting a stimulated 
recall trial was as follows. 

The stimulus lecture (20 minutes in length) 
was recorded on video tape several days in 
advance of the scheduled trial. This taped lec- 
ture did not differ in any way from the usual 
lecture except for its abbreviated length. Dur- 
ing the taping, the experimenter observed from 
the studio and noted the position on the tape 
of possible “critical points.” A critical point 
was grossly identifed as any point in the 
lecture that would be likely to evoke some kind 
of student thinking. Operationally, at such 
points, the lecturer generally asked a question, 
defined a term, or attempted to synthesize and 
relate concepts. Finally, three to five critical 
points were selected from each lecture: the 
first of these 4-5 minutes after the lecture 
began, and the succeeding ones spaced at 3-5 
minute intervals. n 

On the day of the stimulated recall trial, the 
taped lecture was presented on TV. Students 
were given no indication that the lecture was 
taped rather than live, that it was to run 
for only 20 minutes, Or that anything unusual 
would occur during the class period. 

The stimulus lecture terminated with the 
instructor introducing the experimenter to the 
class as a researcher. The experimenter asked 


the proctor who had just come into the re- 
ceiving room to administer the tests with 
which he had been provided. One of these 
tests was designed to validate the stimulated 
recall procedure and is discussed subsequently 
in more detail. 

Upon completion of the testing (approxi- 
mately 20 minutes), the experimenter reap- 
peared on camera to prepare the students for 
the stimulated recall trial. He explained that 
the lecture just seen had been recorded on 
video tape; it would be replayed from the be- 
ginning; students were to attempt to adopt the 
“frame of mind” they had at the beginning of 
the class period and “relive” the first 20 min- 
utes of the hour; the tape would be interrupted 
at several critical points; at each of these stops 
the respondent was to write on the sheet pro- 
vided him “whatever he was thinking at that 
point during the original presentation.” As- 
surances were given concerning the confidential 
nature of the replies. 

Following this introduction, the tape was 
replayed from the beginning, hopefully taking 
the viewers back about 45 minutes in time. 
It was stopped at the first critical point by 
prearrangement with the studio staff, and the 
experimenter repeated the instruction to “write 
down what you were thinking at this point 
during the original presentation.” A time lapse 
of 2 minutes was allowed for students to write 
their thoughts, and the tape was started from 
the preceding stopping place. This procedure 
was followed for all stops within a trial. 

Three such trials were conducted with this 
group of students. The first trial involved a 
portion of a lecture on visual defects and had 
three stops; the second stimulus lecture con- 
cerned fundamental concepts in psychological 
measurement and had four stops; the third lec- 
ture concerned projective techniques and had 
five stops. Thus for each subject we obtained 
his statement of thoughts in situ on 12 occa~ 
sions, sampling three lectures spaced oer 
approximately a 5-week period. 

The validation test administered in one 
viewing section between the end of the stimulus 
lecture and the beginning of the stimulated 
recall playback was mentioned above briefly. 
This achievement test contained two kinds 
of items: “critical” items measuring knowl- 
edges conveyed at or immediately preceding 
each scheduled stimulated recall stopi and 
“control” items measuring knowledges con- 
veyed within the chapter of the textbook 
from which the lecture was drawn but not 
discussed or implied in the lecture itself. Each 
of these tests contained 2 critical items for 
each stimulated recall stop and between 10 and 
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12 control items. Across the three trials, we 
obtained scores for each subject on 24 critical 
items and 34 control items. 

The score on the control items reflected 
knowledges acquired in these three topical 
areas from extra-class sources. The score on 
the critical items reflected the influence of these 
extra-class sources of information in combina- 
tion with exposure to the lecture. Hence, as a 
test of validity of stimulated recall, the total 
stimulated recall scores across the three trials 
(indicating relevance of thinking) were cor- 
related with the critical item subscores par- 
tialing out the control item subscores. This 
partial correlation reflects the validity of stu- 
dents’ reports about their thinking aguinst a 
criterion of acquisition corrected for knowl- 
edges acquired from sources other than the 
class lecture. 


RESULTS ~ 


The findings are most conveniently 
summarized under four headings: Scor- 
ing for Relevance of Thinking, Interrater 


Reliability, Validity, and Intratrial and 
Intertrial Consistency. 


Scoring for Relevance of Thinking 


Bloom (1953) suggested a system for 
coding (but not for weighting) thoughts 
evoked by his stimulated recall proce- 
dure. Our first step in developing a 
scoring system was to code the data 
using Bloom’s categories. This coding 
was accomplished independently after a 
minimum amount of preliminary train- 
ing by statistical clerks serving as 
judges. Two judges coded each stop. 

The coding categories with illustra- 
tions of each are reproduced below. 
These are identical to Bloom’s categories 
with the exception of Classification Tif, 
added to handle a number of responses 
in our study. 


I. Irrelevant thoughts 
a. Thoughts about persons, objects 
and events not in the classroom 
environment (“I was wondering 
if John would ask me to go to the 
dance on Saturday.”) 


b. Tangential thoughts about words 
and phrases used in the lecture 
(“Myopia sure is a funny sound- 
ing word.” “Mr. X sure says ‘uh’ 
a lot while he lectures.”) 

II. Relevant thoughts 

a. Passive thoughts about the subject 
(“I was just taking notes.” “Just 

ı listening.”) 

b. Thoughts evidencing simple com- 
prehension of the subject (“Some- 
body with tunnel vision would 
have to move his eyes around to 
see things at the sides,”) 

c. Thoughts involving attempts to 
apply and utilize the subject mat- 
ter (“I am nearsighted and was 
thinking about becoming far- 
sighted later in life and probably 
having to wear bifocals.”’) 

d. Thoughts involving attempts to 
find solutions to problems or syn- 
thesize the subject (“He [in- 
structor] said that much special 
training is required to interpret 
Pprojectives correctly. I wonder how 
Practical they are for routine use. 


Can’t they be put in an objectively 
scorable form?”’) 


e. Thoughts involving evaluation of 

the meaningfulness and accuracy 
of the lecture (“I don’t believe 
you can tell very much from a 
figure drawing, Talent would 
enter into what you draw.” 
Thoughts wherein questions be- 
yond the presentation are asked 
(“Is it unusual for a person to 
make more than one response to 


cither a part of a blot or the whole 
blot?”) 


In using this system of coding, each 
judge read the reported thought and de- 
cided first whether subject’s thinking 
was relevant or irrelevant. Then he as. 
signed the appropriate code designation 
indicating the category of relevant or 
irrelevant thinking into which he judged 


By 


Pn 
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it to fit. Whenever a subject reported 
both relevant and irrelevant thoughts at 
a given stop, the judge always assigned 
the code designation only for the rele- 
vant thought. 

Four experimenters independently 
rated the eight coding - classifications 
using the paired-comparisons technique. 
Every classification was compared with 
every other classification and a judg- 
Hien made about which represented the 

more relevant” thinking. Similar 
paired-comparison judgments were made 
by seven persons who had considerable 
prior experience in actually coding stim- 
ulated recall responses. 

Summaries of these two sets of paired- 
comparison ratings agreed closely. The 
code categories were distributed along 
a continuum of “thinking relevance” on 
the basis of these ratings in accord with 
the following numerical weights: 


Irrelevant thoughts (Ia and Ib) =0 
Relevant thoughts 


Ia, IIb =2 
IIc, Ie, If =4 
IId =5 


These weights were applied to the 
coded thought contents and summed 
across stops for each trial to yield “trial 
scores,” and across the three trials to 
yield total scores. All analyses of stimu- 
lated recall data subsequently described 
involved the utilization of these weights 
and scores. 


Interrater Reliability 


Each stimulated recall response was 
coded independently by two judges. Cor- 
relations between the numerical conver- 
sions for each pair of judgments are 
summarized for 225 subjects in Table 1. 

Interrater reliabilities for the 12 stops 
ranged between ‘47 and .76 with a me- 
dian value of .58. When total trial 
scores were considered, interrater agree- 
ment ranged from a low of .65 on Trial 
3 to a high of .77 on Trial 1. Since our 


TABLE 1 


INTERRATER RELIABILITIES 


Trial Stop r 
I 1 69 
2 -76 
3 70 

Total score a7 
Il m 1 37 
2 Ad 
3 59 
4 64 

Total score 70 
Ml 1 62 
2 55 
3 AT 
a 4 56 
5 55 

65 


Total score 


raters received relatively little prelimi- 
nary training, it is likely that these co- 
efficients are minimum estimates of the 
interrater reliability that may be antici- 
pated in scoring stimulated recall data. 

Discrepancies between the weights as- 
signed to given responses by pairs of 
judges were arbitrated by experimenters 
prior to conducting the validity and con- 
sistency studies described in the follow- 


ing sections. 


Validity 

The crux of the utility of stimulated 
recall as a criterion of student thinking 
is its validity. Do students’ reports 
about what they were thinking at vari- 
ous points in the stimulus lecture corre- 
Jate with an independent measure of 
what they have learned at these points 
solely as a result of the lecture? Pre- 
sumably, students indicating that they 
were inattentive to the presentation 
ought to have learned very little from 
it. Conversely, students reporting highly 
relevant thinking should be expected to 
show a parallel gain in knowledge from 
the stimulus lecture. 
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As described earlier, the design for 
validation involved administration of an 
achievement test consisting of subsets of 
critical items and control items in one 
of the viewing sections (N=47). Per- 
formance on the control items was as- 
sumed to reflect information in the gen- 
eral area of the lecture topic acquired 
from sources other than the lecture pres- 
entation itself. 

The correlation matrix for total scores 
(across the three trials) on critical items, 
control items, and stimulated récall is 
shown in Table 2. The correlation be- 
tween stimulated recall and critical item 
Scores partialing out the control item 
Scores was .61. It is evident that stimu- 
lated recall scores do, in fact, correlate 
with a measure of achievement reflect- 
ing knowledges gained from the lecture 
itself. The higher the level of thinking 
relevance displayed by a student during 
stimulated recall, the greater is the like- 

lihood that he will learn the knowledges 
conveyed during the lecture, 


Intratrial and Intertrial Consistency, 


The factors affecting the internal con- 
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TABLE 2 


INTERCORRELATIONS BETWEEN SCORES ON 
CRITICAL ACHIEVEMENT ITEMS, CONTROL 
ACHIEVEMENT ITEMS, AND 
STIMULATED RECALL 


Control 


Critical Stimulated 
Item items items recall 
Critical X 28 59 
Control X .02 
Note.—N = 47, 


parallel those affecting the intcrnal con- 
sistency of achievement test item re- 
sponses. However, one aspect of stimu- 
lated recall is uniquely important: the 
character of student thinking may be 
presumed to be particularly sensiti- e 
to fluctuations of interest during a given 
stimulus lecture and in different lectures, 

The present design sampled thinking 
during three different lectures and at 
three to five points within each lecture, 
The intercorrelations reflecting intratrial 
and intertrial consistency of thinking are 
exhibited in Table 3, 


Although the means and standard 
deviations of relevance scores 


are rela- 
sistency of stimulated recall responses tively Stable, the intratrial and intertrial 
TABLE 3 
INTRATRIAL AND INTERTRIAL CONSISTENCY oF STIMULATED RECALL Scores 
Trial I Trial II Trial 
Trial 1 2 3 Total 1 2 3 4 Total 1 2 3" my 5 Total 
| o tas woe OMe Iit sh as ia Gan Ge 
Sb 1.34 135 1.42 3.32 117 Lor 10 1.16 100 322 
T oin X 35 22 
Stop sy 
Stop 2 = a 
Stop 3 
Total score 25 a 
xX 2 2 as 
Stop 2 sey 
Stop 3 se: Oe 
Stop 4 29 
Total score 
1T X l4 13 13 o8 
Stop 1 X 238 6 “19 
Stop 2 X 30 120 
Stop 3 X a 
Stop 4 X 
Stop 5 ~ 
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correlations tend to be fairly low. Hence, 
there is no strong evidence for the exist- 
ence of characteristic patterns or “styles” 
of thinking. 

The practical implication of this find- 
ing for the use of stimulated recall to 
provide a research criterion involves the 
sampling problem. How many trials in- 
volving different stimulus lectures are 
required to obtain a reasonably stable 
measure of student thinking? This is- 
sue may be viewed from a prediction 
standpoiit. From this perspective, the 
question becomes: “How many trials 
[t] are required to reach the point where 
the multiple correlation Re-t-ı is essen- 
tially identical to Ret?” 

Our data were not sufficient to answer 
this problem definitively. The correla- 
tion between Trial 1 and Trial 2 scores 
was .25. The multiple correlation using 
Trials 1 and 2 as joint predictors of 
Trial 3 was .41. We have no way of 
knowing what the multiple correlation 
using Trials 1, 2, and 3 in combination 
to predict a fourth trial would have been. 
However, we infer from the relatively 
substantial validity coefficient obtained 
for the three-trial total, that this multi- 
ple correlation would have been substan- 
tially higher than .41 if the data had 
been available. 


DISCUSSION AND CONCLUSIONS 


Student thinking evoked by stimulus 
lectures and assessed for relevance by 
means of a stimulated recall technique 
holds promise as a research criterion. 
Although the resultant data are sub- 
jectively scored, interrater reliabilities 
were reasonably high. Furthermore, the 
resultant scores for thinking relevance 
had demonstrated validity against an 
objective measure of knowledges ac- 
quired. from the stimulus lecture. 

This research leads to the conclusion 
that student thinking sampled at various 
points within a lecture and across lec- 
tures is relatively inconsistent with re- 
spect to relevance. The implication of 
this finding for use of the stimulated 
recall technique to provide criterion data 
is that it is desirable to sample across a 
variety of topics. Although the optimal 
number of required trials is not known, 
the present investigation supports the 
use of at least three trials to reflect 
variations in student mood and interest. 
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In Brown’s (1960) study of the learning of personality items which were 
paired with nonsense syllables, a major f nding was that social desirability 
response style was related to learning measures for women but not men. 
A reanalysis of these results found that social desirability response style 
was related to delayed recall for both men and women, and confidence 
and immediate recall for women only. It was not related to trials to 


mastery, learning time, and, blockings. 
partially supports Edwards’ social desirability response style reinterpre- 
tation of studies of anxiety and learning, but that many previous studies 


do not. 


It was concluded that this study 


The relationship between social de- 
sirability response-style and learning 
performance has been investigated by 
Brown (1960) in a study of paired-asso- 
ciate learning. Men and women who 
were classified as high or low in social 
desirability response style on the basis 
of their scores on Edwards’ (1957) So- 
cial Desirability (SD) scale learned 
16 statements from the Edwards Per- 
sonal Preference Schedule (EPPS, Ed- 
wards, 1953) which were paired with 
nonsense syllables. The statements rep- 
resented two levels of social desirability 
and two levels of descriptiveness (the 
latter variable was derived from each 
subject’s classification of the statements 
as “like me” or “not like me”). 

Brown reported the results for four 
.lypendent variables: (a) confidence! 
subject’s estimate, after two learning 
trials, of the number of trials he would 
need to complete the learning task ; (b) 
trials to mastery; (c) immediate recall 
—number of statements recalled im- 
mediately after learning; (d) delayed 
recall—number of statements recalled 
24 hours after learning. 


1 Since only an overall confidence rating, 
without respect to the characteristics of the 
statements of the EPPS, was obtained, assess- 
ment of the confidence associated with differ- 
ent item types is precluded. 
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One major finding was that there was 
no overall difference on any of these four 
variables between those subjects in the 
high and low social desirability response 
style groups, but social desirability re- 
sponse style was related to all variables 
for women, but not men (i.e., women 
with high social desirability response 
style had higher confidence, learned in 
fewer trials, and had greater immediate 
and delayed recall), 

Brown’s statistical analysis makes it 
difficult to assess the meaning of this and 
other findings. It consisted of ¢ tests of 
overall mean differences on each of the 
four learning measures between the high 
and low social desirability response-style 
groups within each sex group, and analy- 
ses of variance of overall differences 
among the four sex-social desirability 
tesponse-style subject groups and among 
the four social desirability-descriptive- 
ness item types, and the interaction be- 
tween the subject and item type varia- 
bles. Hence, it is not possible to assess 
directly the independent effects of each 
of the two subject variables or each of 
the two-item variables or the interactions 
among these four variables. Since 
Brown’s findings are important and in- 
teresting, his data were reanalyzed to 
evaluate these issues. 
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METHOD 


The raw data reported by Brown (1957) 
for six variables were reanalyzed—the four 
learning measures analyzed by Brown (1960) 
as well as two other learning measures which 
were originally investigated but not analyzed— 
blockings (the number of třials between ini- 
tial success and final mastery of an item) and 
time needed for mastery. Learning time end 
level of confidence were each analyzed in sep- 
arate 2 X 2 factorial design analyses of vari- 
ance based on two between subject variables— 
sex and social desirability response style.* The 
other four variables—number of trials to 
mastery, number of blockings, immediate recall, 
and delayed recall—were analyzed in an ex- 
tended Lindquist (1953) Type III design 
analysis of variance, based on two between- 
subject variables—sex and social desirability 
response style—and two within-subject vari- 
ables—nem social desirability and item descrip- 
tiveness. Transformations were applied to four 
variables to reduce heterogeneity of variance. 


RESULTS 


The mean squares and F ratios for 
the analyses of variance of learning time 
and level of confidence appear in 
Table 1, These statistics for the other 
variables appear in Table 2.8 Results 


2 Only overall measures, without respect to 
the characteristics of the statements of the 
EPPS, are available for these two dependent 
variables. 

8 Some of the statistics 
variance of trials to mastery 
from the statistics reported by Brown (1960), 
evidently because of a minor typographical 
crror in the tabulations of raw data in 
Brown’s (1957) Table 19. 


for the analysis of 
differ slightly 


are reported for both the raw and trans- 
formed data, but only the results for the 
transformed data are discussed for the 
variables which required transformation. 

The overall difference between high 
and low social desirability response-style 
groups was significant ( < .05) for two 
dependent variables—confidence and de- 
layed recall; „those with high social de- 
sirability response style had greater con- 
fidence and recall. There was no overall 
significant (p > -05) difference between 
men and women on any of the six de- 
pendent variables. 

Interactions between sex and social 
desirability response style were signifi- 
cant (p <.05) for three dependent 
variables: confidence, learning time, and 
immediate recall. These three interac- 
tions were produced by greater differ- 
ences between the two women’s groups 
than between the two men’s groups, and 
opposite trends for men and women on 
two variables—learning time and im- 
mediate recall. Compared with the 
women with low social desirability re- 
sponse style, the women with high social 
desirability response style had signifi- 
cantly (p < -05) greater confidence and 
immediate recall, as determined by 
Scheffé’s (1953) test. Despite the over- 
all significant difference in confidence be- 
tween high and low social desirability 
response-style groups, the two men’s 
groups did not differ significantly (p > 


TABLE 1 
ANALYSIS OF VARIANCE OF CONFIDENCE AND LEARNING TIME 

Confidence Confidence Learning moe 

Source d (Raw) (Log X) (In minutes’ 

i MS F MS F MS F 

SD style 1 1081.600 3.78 s04 6.52* 562.500 2.23 
Sex 1 000 — i7 152 12250 = 
SD style X Sex 1 1040.400 3.63 381 4.93* 1440.000 sai* 
Within (error) 36 286.456 = 077 a 252.083 m 
ge i ee ee 2a — 


; TABLE 2 
ANALYSIS OF VARIANCE OF TRIALS TO MASTERY, BLOCKINGS, IMMEDIATE RECALL, AND DELAYED RECALL 


I 


$s 
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—— AE E NN a 
Trials to Trials to Blockings Immediate Immediate Denya 
Source mastery mastery Blockings (Log recall recall recall 
(Raw) (Log X) (Raw) X41) (Raw) (Arcsin) (Raw) 
MS MS MS F MS F MS MS F MS F 

SD style O a i 048 21.756 217 123 114 3906 2138.906 3.75 10.000 5.00* 
Sex 156 000 B o0 å — 506 113.906 — gg = 
Item descriptiveness (ID) 162.006 015 306 — Cig = 756 68.906 — 1.600 1.68 
Item social desirability (ISD) 897.756 073 33.306 3.64 413 4.28" 5.256 2600.156 6.74% 1.225 1.29 
SD style X Sex 1398.306 108 29.756 2.97 362 3.34 7.656 3657.656 6.42* 3.600 1.80 
ID X SD style 13.806 001 056 — üs = 006 12.656 — gs = 
ID X Sex 156 000 61.256 6.70% 157 1.63 056 1406 — 400 — 
ID X ISD 45.156 003 24.806 2.71 165 1.71 056 68.906. — 106 + 
ISD X SD style 24.806 001 20.306 2.22 205 2.13 006 1406 — 900 — 
ISD X Sex 2.256 000 7.656 — My « 306 68.906 — 625 — 
ID X ISD X SD style 4.556 001 i — og = 006 S15 = a = 
ID X ISD X Sex 47.306 003 10.506 1.15 065 — 156 68.906 — 900 — 
ID X SD style X Sex 51.756 003 13.806 1.51 147 1.52 3.306 1182.656 3.06 1.225 1.29 
ISD X SD style X Sex 6.006 001 28.056 3.07 250 2.59 156 Sg — 100 — 
ID X ISD X SD style X Sex 1.406 000 8.556 — T a 306 237.656 — ie = 
Error. 482.120 043 10.017 108 1.403 570.156 1.999 
Errors? 68.692 005 9.147 097 S74 385.990 950 

b e ee ero ne eee 

5 = Ol. 
3 s 


` 


SOCIAL DESIRABILITY AND LEARNING 55 


.05) on this variable, learning time, or 
immediate recall. 

Item social desirability was significant 
(p < .05) for trials to mastery, block- 
ings, and immediate recall; the socially 
desirable items were learned in fewer 
trials, involved fewer blockings, and had 
greater immediate recall. Item descrip- 
tiveness was not significant (p > 05) 
for any dependent variable. 


DISCUSSION 


The finding that social desirability re- 
sponse style was not related to all the 
learning measures for either the male or 
female groups, much less both groups, 
sharply limits the interpretation of these 
results. The sex differences in the rela- 
tionship of social desirability response 
style and learning may have been pro- 
duced, as Brown suggested, by interac- 
tions of the subjects or experimental con- 
ditions with the experimenter ; there was 
only one experimenter, a male, in this 
study. This interpretation is supported 
by the mounting evidence of such ex- 
perimenter-linked interactions in studies 
of anxiety and learning (Axelrod, 
Cowen, & Heilizer, 1956; Heilizer, Axel- 
rod, & Cowen, 1956). 

The present finding that social de- 
sirability response style was related to 
delayed recall for men and women, and 
confidence and immediate recall for 
women, and the finding by Jackson and 
Pacine (1961) that the tendency to 
make socially desirable responses tO 
California Psychological Inventory items 
and college grade-point average were 
related lend some support to Edwards’ 
(1957) reinterpretation of studies of the 
relationship of anxiety and learning.* 


4 It should also be noted that two studies 
of verbal conditioning (Crowne & Strick- 
land, 1961; Marlowe, 1962) found that high 
scorers on the Marlowe-Crowne SD scale 
(Crowne & Marlowe, 1960) were more condi- 
tionable than low scorers. These findings do 


Viewing such studies as demonstrating 
the generality of a tendency to make a 
good impression, he argues that those 
who tend to make a good impression on 
personality scales (e.g, by giving so- 
cially desirable responses), and hence 
report little anxiety on the Manifest 
Anxiety (MA) scale (Taylor, 1953), 
also make a good impression in learning 
situations (e.g°, by learning faster, etc.). 
Nonetheless, Edwards’ reinterpreta- 
tion does not adequately explain the re- 
sults of many previous studies of anxiety 
and learning. Although it asserts that 
subjects who have high social desira- 
bility response style, and hence report 
little anxiety°on the MA scale, should 
generally have superior learning, the 
bulk of the findings of previous studies 
(Sarason, 1960; Taylor, 1956) indi- 
cates that low anxious subjects only have 
superior performance on complex learn- 
ing tasks (such as the one investigated 
by Brown); their performance is in- 
ferior on simple learning tasks. While 
this interaction between the MA scale 
and task complexity cannot be predicted 
by the social desirability response-style 
interpretation, it can be explained by 
current conceptualizations of anxiety as 
a drive variable and affective state. 
Since social desirability response style, 
when it is conceptualized as a tendency 
to make a good impression, is not as 
adept as anxiety in accounting for exist- 
ing findings, even though these two per- 
sonality variables are presumed to be 
highly related at both the artifactual 
and substantive levels (Edwards, 1957), 
it may be more meaningful to consider 
this response style, at least on person- 
ality scales, as simply a reflection of 
anxiety. 
not seem relevant to an evaluation of Edwards’ 
conceptualization because the Marlowe-Crowne 
SD scale more resembles a Lie scale than an 


SD scale, and these two kinds of scales measure 
distinctly different variables (e.g. Jackson & 


Messick, 1962). 


56 Lawrence J. STRICKER 


REFERENCES 


AxELROD, H. D., Cowen, E. L., & HEIizer, F. 
The correlates of manifest anxiety in stylus 
maze learning. J. exp. Psychol., 1956, 51, 

-138. 

Pict, | K. A study of the relationship be- 
tween social desirability as a psychological 
variable and learning performance in a com- 
plex verbal task. Unpublished doctoral dis- 
sertation, University of Washington, 1957. 

Brown, P. K. The social desirability variable 
and verbal learning performance, J. educ. 
Psychol., 1960, 51, 52-59. 

Crowne, D. P., & Martows, D. A new_scale of 
social desirability independent of psycho- 
pathology. J. consult. Psychol., 1960, 24, 
349-354. 

Crowne, D. P., & STRICKLAND, BONNIE R. The 
conditioning of verbal behavior as a func- 
tion of the need for social approval. J. 
abnorm. soc. Psychol., 1961, 63, 395-401. 

Epwarps, A. L. Manual for the Edwards Per- 
sonal Preference Schedule, New York: Psy- 
chological Corporation, 1953, 

Epwarps, A. L. The social de 
in personality assessm 
York: Dryden, 1957, 

Hetzer, F., AXELROD, 
The correlates of ma 


Sirability variable 
ent and research. New 


H. D, & Cowen, E. L. 
nifest anxiety in paired 


associate learning. J. Pers, 1956, 24, 463- 
474, 

Jackson, D. N., & Messicx, S. Response styles 
on the MMPI: Comparison of clinical and 
normal samples. J. abnorm. soc. Psychol., 
1962, 65, 285-299, 

Jackson, D. N, & Pacing, L. Response styles 
and academic achievement. Educ. psychol. 
Measmt., 1961, 21, 1015-1027. 

Lrxpguist, E. F. Design and analysis of ex- 
periments in psychology and education. Bos- 
ton: Houghton Mifflin, 1953. 

Martowe, D. Need fi 
the operant 
verbal behavio: 
26, 79-83. 

Sarason, I. G. Empirical findings and theo- 
retical problems in the use of anxiety scales. 
Psychol. Bull., 1960, 57, 403-415, 

Scnrrré, H. A method for judging all co-.- 
trasts in the analysis of variance, Bio- 
metrika, 1953, 40, 87-104, 

TAYLOR, JANET A. A personality 
fest anxiety. J, abnorm. soc. 
48, 285-290, 

TAYLOR, JANET A. Drive theory and manifest 
anxiety. Psychol, Bull., 1956, 53, 303-320. 


or social approval and 
conditioning of meaningful 
r. J. consult, Psychol., 1962, 


scale of mani- 
Psychol., 1953, 


(Received July 19, 1962) 


fo 


Journal oj Educational Psychology 
1963, Vol. 54, No. 1, 57-62 


PERCEPTUAL RECOGNITION OF APPROXIMA- 
TIONS TO ENGLISH IN RELATION 
TO SPELLING ACHIEVEMENT 


MICHAEL A. WALLACH 
Duke University 


In an experiment with 55 5th-g ade children, ease of perceptual recog- 
nition was determined for nonsense words which resemble English and 
for nonsense words which do not. With all childrenebeing equated in 


recognition accuracy for the 


recognize the former words much more 
and further results permitted the conc 
© much greater transfer of training th 
for this transfer rests on the learning of 


latter words, good spellers were found to 


readily than poor spellers. These 
lusion that good spellers show 


an poor spellers—whether the basis 


the sequential probability 


structure of letters, on phonetic generalization, or on both. 


— 


. The present study bears on the ques- 
Uon of whether spelling achievement 
may importantly depend on transfer of 
training. The basis for such transfer 
may rest on learning the general se- 
quences in which letters tend to fall in 
the language, on phonetic generaliza- 
tion, or on both. To the extent that good 
spelling depends on such transfer of 
training, rather than just on learning 
the specific letter and sound sequences 
involved in particular words that are 
studied, nonsense words which resemble 
English, such as APHYST Or EDITOL, 
should be more familiar for good spellers 
than for poor. Since familiarity is a 
powerful determinant of ease of percep- 
tual recognition when a word is exposed 
for a brief period of time (Howes & 
Solomon, 1951), good spellers hence 


_ The research reported herein was supported 
in part through Grant M-1324 from the 
National Institute of Mental Health, Public 
Health Service, and in part through the Co- 
operative Research Program of the Office of 
Education, United States Department of 
Health, Education, and Welfare. The former 
grant was under the general direction of J. S. 
Bruner, whose encouragement and aid are 
gratefully acknowledged. Thanks also are due 
W. D. Rohwer, Jr., for his assistance in con- 
ducting the study. Preliminary results which 
Provided the impetus for the present investi- 
Bation were obtained by W. Hull. 
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should recogaize such nonsense words 
more easily, when they are presented 
tachistoscopically, than do poor spellers. 

The present experiment tests predic- 
tions which hence are derived from the 
hypothesized importance for spelling of 
phonetic transfer—transfer of sound- 
letter rules based on the pronouncea- 
bility of sound sequences—and of learn- 
ing the sequential probability structure 
of letters. While these two factors may 
turn out to be related, a focusing of 
attention on the latter suggests some new 
implications regarding what one should 
attempt to teach in order to improve a 
child’s spelling. Whereas teaching pro- 
cedures based on phonetic training have 
been in use for some time, there has 
been little attempt yet to base training 
procedures on transfer involving the 
sequential probability structure of let- 
ters. These implications will be explored 


later in the paper. 


METHOD 


Subjects 

The subjects were 55 fifth grade children 
from a public school in suburban Boston, ap- 
proximately equally divided between the sexes.? 
verly, Superin- 
irector of 
Principal 


2 Thanks are due E. R. Ca 
tendent of Schools, J. R. Hobson, D: 
Child Placement, and Elgie Clucas, 
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i no sex differences were found in any of 
e results in the study, the data 
for both sexes were pooled. All the children 
were of middle or upper-middle class socio- 
economic status. 


General Procedure and Predictions 


The experimental procedure required first 
that we equate all children with regard to 
degree of perceptual recognition accuracy for 
nonsense words consisting of completely ran- 
dom letter sequences. This was achieved by 
setting the length of tachistoscopic exposure 
for each subject at the duration required for 
him to recognize approximately 33% of the 
letters in such words correctly. The basic per- 
ceptual measure then consisted in the degree 
of increase in recognition accuracy exhibited 
for nonsense words consisting of familiar letter 
sequences. Our major prediction was that this 
measure of degree of increase in recognition 
accuracy would be strongly correlated with 
spelling achievement. We expected further 
that degree of increase in recognition accuracy 
would be less strongly correlated with achieve- 
ment indices in fields other than spelling, and 
with general intelligence, In other words, we 
predicted a relationship between recognition 
accuracy for nonsense words that resemble 
English and spelling achievement that would 


be specific to spelling achievement in at least 
some degree, 


Perceptual Recognition Session 


Stimulus materials. Two main kinds of six- 
letter words were tachistoscopically exposed to 
each child: words of zero-order and fourth- 
order approximation to English. The words 
themselves were adapted from ones used by 
Miller, Bruner, and Postman (1954). That 
reference and Shannon (1948) describe in detail 
their method of construction, 

In brief, nonsense words of zero-order ap- 
proximation to English are constructed by a 
random sampling of the letters in the alphabet. 
Every letter in the alphabet hence has an 
equal chance of occurrence in each position. 
The result is words such as Grxrwm, VQWBVI, 
and cvocjcp. 

Nonsense words of fourth-order approxi- 
mation to English, on the other hand, are 
extremely close in nature to actual words in 


of the Michael Driscoll School in Brookline, 
Massachusetts, for permission to work with 
the pupils of the Michael Driscoll School in 
carrying out the present research. 


the language. While neither fourth-order 
words nor zero-order words can be found in 
the dictionary, fourth-order words look as if 
they could be English while zero-order words 
do not. Words of fourth-order approximation 
to English are constructed by taking account 
of the sequences in which strings of four let- 
ters occur in the language. Beginning at 
random in English prose with a three-letter se- 
Gaence (such as TER), we search the continua- 
tion of the prose until this three-letter sequence 
occurs again, and then add the letter that 
follows it (yielding, for example, Terv). Con- 
tinuing now with the last three letters (ERV), 
we proceed to read the prose until we find this 
new three-letter sequence again, ard we once 
again add the letter that follows it (the re- 
sult may, for instance, be ERVA). Proceeding 
again with the last three letters (rva), we 
search for its reoccurrence and add the letter 
that follows it (for instance, RvaL), The six- 
letter word is now complete, and reads TERVA.. 
To construct another such word, we again be- 
gin at random in English prose with a new 
three-letter sequence. The result of this proce- 
dure is words such as MOSSIA, PRESPE, and 
APHYST. 

Thus, the fourth-order words are highly sim- 
ilar to English, while the zero-order words are 
completely random strings of letters, 

A third kind of nonsense words, first- 
order approximations, were also included, to 
Serve as a control. Nonsense words of first- 
order approximation to English are constructed 
by a random sampling of letters from English 
Prose. These words hence contain letters in 
relative frequencies Proportional to their likeli- 
hood of occurrence in the language. The se- 
quential structure of these letters, however, 
still is essentially random, Examples are DNEnHS 
and wonmu. It was our expectation that 
sensitivity to mere relative frequency of occur- 
rence per se of letters in English prose would 
not be relevant to good spelling. Rather, we 
predicted that it was sensitivity to the transi- 
tional probabilities governing the arrangement 
of these letters into Sequences that specifically 
underlay good spelling. The first-order words 
hence were included as a control and were 
expected to yield results very close to those 
found for zero-order words. 

Table 1 lists all stimulus words used in the 
study, in their order of presentation. The eight 
zero-order words listed under Part I of the 
table constituted the training series. The se- 
quence shown was presented two or three 
times, with the experimenter varying the ta- 
chistoscopic shutter speed until the recognition 
accuracy criterion of 33% of the letters correct 
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TABLE 1 


StiatuLus Worps IN THEIR SEQUENCE OF 
PRESENTATION 


Part I: Training series 


Word Order of 
approximation 

1, PMZCEN 0 

2. OYOEVZ 0 

3. IJHBWS 0 

4. BHDTUN 0 

5. MFRSIW 0 

6. HHJHUF 0 

“7. GFXRWM 0 

8. YRULPZ o 

Part II: Test series 
Word Order Word Order Word Order 
1. MOSSIA 4 9. oO 17. WDNMII l 
a cvcjcp 0 10. 4 18. TATION 4 
A VTYEHU 1 ll. o 19. wxpauy 0 
a ONETIC 4 12. DNEHHS 1 20. epIToL 4 
A EVERAL 4 13. IDCFRA g 21. TERVAL 4 
7 YDEWAK 1 14. LYMIST 4 22. AAESPW 1 
H VORIAL 4 15. KERSON 4 23. PRESPE 4 
. APHYST 4 16. EGQMNW O 24, vowsvr 0 


was achieved over a block of four successive 
words, The length of exposure that met this 
criterion varied from 1/200 second to 1/5 sec- 
ond for different subjects. 

The 24 words listed under Part II of the 
table constituted the test series. The sequence 
shown was presented two times, with all 48 
Presentations for a given subject being shown 
at the exposure speed which had met the 33% 
recognition accuracy criterion in Part I. Of 
the 24 words in Part II, 12 were fourth-order 
approximations to English, 6 were zero-order, 
and 6 were first-order, Each block of 12 words 
included half the words of each order. 

Apparatus, preliminary familiarization, and 
response materials. A Bell and Howell slide 
Projector was used in conjunction with an Ace 
tachistoscopic shutter. The image was pro- 
Jected on a milk glass screen which the child 
viewed from the other side. The screen was 
Mounted in a wooden cabinet. The six-letter 
Words cast an image 2 inches long and ¥% inch 
high on the screen. The eyes of the viewer 
Were about 3 feet away. Uniform fixation was 
insured by boundary lines which outlined the 
Tectangular space within which each word 
Was flashed. , 

Prior to the training series and test series, 
each child was familiarized with the general 
nature of the tachistoscope by flashing English 


words at varying exposure lengths. The words 
used in this preliminary familiarization were 
LOVELY, MINUTE, BOTTOM, and WINTER. 

Responses to the stimuli in the training and 
test series were written by the child in a 
booklet of blank sheets that he kept in front 
of him. Each sheet of the booklet had room 
for eight words to be filled in. The spaces 
where the letters of each word were to be 
entered were indicated by a row of six dashes. 
The child was instructed always to fill in all 
six spaces for each word that was flashed, 
guessing whenever necessary. 

Perceptual measure. Degree of increase in 
recognition accuracy for potentially familiar 
in contrast to unfamiliar nonsense words was 
determined through a comparison of results 
for the fourth-order and the zero-order words 
in the test series. 

The number of letters correct and correctly 
placed was calcutated for the presentations of 
zero-order words in the test series. Since there 
was a total of 12 presentations of zero-order 
words (6 words shown twice each), there hence 
was an opportunity for 72 correct letters. In 
the case of all 55 subjects, there was success 
in achieving the criterion of 33% of the zero- 
order letters correct in the test series, plus or 
minus 8% as an allowance for accidental vari- 
ation from the criterion.$ All 55 subjects thus 
obtained from 18 to 30 of the 72 letters cor- 
rect, and hence were approximately matched in 
terms of their recognition accuracy level for 
zero-order words. 

The number of letters correct and correctly 
placed was likewise calculated for the fourth- 
order words. Since there was a total of 24 
presentations of fourth-order words (12 words 
shown twice each), there was an opportunity 
for 144 correct letters. Given the fact of twice 
as many fourth-order as zero-order words, the 
number of letters correct for the zero-order 
words was doubled in the case of each child. 

A ratio score was computed for each sub- 
ject, consisting of the number of fourth-order 
letters correct minus twice the number of zero- 
order letters correct, divided by twice the 
number of zero-order letters correct. This 
ratio score may be expressed: 

4th order — 2 (Z0 order) 


2(20 order) 
This measure, in a percenta; 


s A few individuals who fell outside this 8% 
error allowance were discarded from the study 
prior to analysis of the results. A subsequent 
check indicated that their inclusion would not 
have altered any of the findings. 


ge, indicated the 
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degree of increase in perceptual recognition 
accuracy for the fourth-order words, all sub- 
jects being equated at approximately 33% 
recognition accuracy for zero-order words as 
the baseline of comparison. 

i Comparisons between fourth-order and first- 
order words, and between first-order and zero- 
order words, also were carried out for control 
purposes. 


Spelling Achievement, Achievement in 
Other Areas, and Intelligence 


Spelling achievement was assessed from the 
spelling achievement score in the Int-rmediate 
Battery of the Metropolitan Achievement 
Tests (Allen, Bixler, Conner, & Graham, 
1946). Achievement in three other areas also 
was assessed: reading, English, and arithmetic. 
The average reading achievement score, Eng- 
lish achievement score, and average arithmetic 
achievement score, all again from the Inter- 
mediate Battery of the Metropolitan Achieve- 
ment Tests, provided the measures, General 
intelligence, finally, was assessed from the 
Kuhlmann-Anderson (1942) IQ. The IQ was 
chosen as the general intelligence measure in 
order to provide an assessor that would be as 
standard, general, and familiar in its psycho- 
logical significance as possible, For, in the case 
of intelligence, our specific interest was in an 
overall evaluation of ability. The Metropolitan 
Achievement Tests (Intermediate Battery) and 
the Kuhlmann-Anderson Intelligence Tests were 
administered to all of our fifth grade subjects 
during the spring term of the fifth grade year. 


RESULTS AND Discussion 


The ratio scores indicating degree of 
increase in perceptual recognition accu- 
racy for fourth-order as compared with 
zero-order words varied from 11.9% im- 
provement to 197.2% improvement, i.e., 
from almost no improvement at all to 
almost 200% improvement. The first 
and major prediction of the experiment 
concerned the relationship between these 
scores and spelling achievement scores. 
As indicated in Table 2, the product- 
moment correlation coefficient between 
the two variables is .47, which is signifi- 
cant well beyond the .001 level of confi- 
dence for the sample size of 55. Our 
next prediction concerned the degree of 


TABLE 2 


PRODUCT-MOMENT CORRELATION COEFFICIENTS 
BETWEEN DEGREE OF INCREASE IN RECOGNITION 
Accuracy FOR FOURTH-ORDER AS COMPARED 
WITH ZERO-ORDER Worps, AND VARIOUS MEAS- 
URES OF INTELLECTUAL PERFORMANCE 


Measure F 
Spelling achievement a aaa: 
Average reading achievement a "c Y inata 
English achievement a 33* 
Average arithmetic achievement 2 .30* 
IQ» 23 
Note.—N = 5. 


S. 
* Metropolitan Achievement Tests: Intermediate Bat- 
tery (Allen et al. 


1 1946). 
uhlmann-Anderson Intelligence Tests (Kuhlmann 
& Anderson, 1942), 


S. 


specificity of this relationship. We find 
from Table 2 that the perceptual meas- 
ure is not as strongly related to average 
reading achievement scores, although 
this relationship is still significant (r= 
37, which is significant beyond the 
:01 level). We also note that the percep- 
tual measure is still less strongly related 
to English achievement, and even less 
strongly related to average arithmetic 
achievement (r=.33 and 30, respec- 
tively, both of which are significant be- 
yond the .05 level). Finally, we find 
that the perceptual measure is not sig- 
nificantly related to general intelligence 
(r=.23). 

` The question of whether the various 
correlations we have reviewed are reli- 
ably different from each other was in- 
vestigated by means of a technique de- 
veloped by Hotelling (see Walker & Lev, 
1953, pp. 256-257). By a two-tailed ¢ 
test (which actually is conservative since 
our prediction specifies direction), the 
correlation of .47 between the perceptual 
measure and spelling achievement is dif- 
ferent from the correlation of 23 be 
tween the perceptual measure and gen- 
eral intelligence at almost the OS level 
(¢=2.00). The .47 correlation is not 
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significantly different from the other cor- 
relations by Hotelling’s technique, how- 
ever. 

Partial correlation coefficients, in 
turn, were computed between the per- 
ceptual measure and spelling achieve- 
ment, holding statistically constant the 
reading, English, arithmetic, and IQ 
scores in succession. In every case the 
partial correlation coefficient remained 
significant at the .05 level or better. 

Not only, therefore, is there a strong 
relationship between the perceptual 
measure and spelling achievement, but 
also this relationship is specific to spell- 
ing achievement in at least some degree. 

he perceptual measure is less strongly 
related tu indices of verbal achievement 
in areas other than spelling, is still less 
strongly related to achievement in the 
numerical sphere, and is not significantly 
related to a general omnibus intelligence 
score. Furthermore, even when each of 
these latter indices is held constant sta- 
Ustically, there remains a significant re- 
lationship between the perceptual meas- 
ure and spelling achievement. 

Regarding the perceptual findings for 
first-order words, the following results 
Were obtained, Ratio scores based on 
degree of increase from first-order to 
fourth-order words yielded correlation 
results essentially identical to those just 
described for ratio scores based on de- 
gree of increase from zero-order to 
fourth-order words. In turn, ratio scores 
based on degree of increase from zero- 
order to first-order words yielded non- 
Significant correlations in all cases. 
These control results demonstrate that 
Sensitivity to mere relative frequency of 
Occurrence per se of letters in English 
does not underlie spelling achievement. 
Rather, it is sensitivity to the transi 
tional probabilities that characterize the 
Sequential ordering of these letters that 
Specifically underlies spelling achieve- 
ment, 


. We may conclude that the degree of 
increase in perceptual recognition ac- 
curacy for nonsense words whose letters 
constitute close approximations to the 
sequential structure of English, as com- 
pared with nonsense words whose letters 
are arranged in random sequences, is 
strongly correlated with spelling achieve- 
ment. In addition, this correlation pos- 
sesses a goodly degree of specific connec- 
tion with the spelling achievement 
variable. These results are consistent 
with the proposition that good spellers, 
in contrast to poor spellers, are learning 
not just to spell particular words, but 
rather also are learning a much more 
general property of English words— 
namely, the transitional probability 
structure governing the sequential ar- 
rangement of letters in such words. The 
present results also are consistent with 
the proposition that spelling achievement 
is dependent upon phonetic transfer or 
phonetic generalization — transfer of 
sound-letter rules based on the ease of 
pronunciation of sound sequences. 
Whether or not the two proposals 
turn out to be related, however, con- 
sideration of the findings of the experi- 
ment from the viewpoint of the sequen- 
tial probability structure of letters 
suggests some new implications that may 
be of relevance for the teaching of spell- 
ing. It is consistent with the results of 
the present experiment to suggest that 
one problem for poor spellers—or for 
some poor spellers—may be their lack 
of internalization of the transitional 
probability structures that characterize 
letter sequences in English. One peda- 
gogical approach to this problem might 
be to present poor spellers with non- 
sense words of varying degrees of ap- 
proximation to English and reward them 
for correctly discriminating the ones that 
are most like English. This would be a 
“concept attainment” type of procedure 
in which the correct instances of the 
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concept in question are nonsense words 
of fourth-order approximation to Eng- 
lish. As poor spellers become more pro- 
ficient at attaining this concept, they 
will be learning to recognize the general 
letter sequences that characterize Eng- 
lish words. This new knowledge, in 
turn, then may aid their spelling of par- 
ticular English words. 

The present experiment strongly sup- 
ports the conclusion that good spellers 
show much greater transfer of training 
than poor spellers—whether the basis 
for this transfer depends on the learning 
of the sequential probability structure of 
letters, on phonetic generalization, or on 
both. 
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An attempt was made to identify differential college 


effects on the stu- 


dent’s motivation to seek the PhD degree. An input-output design for 


controlling differential student input was applied in 


study of 6544 high aptitude students. PhD aspira 
the size of the student hody, the percentage of 


d the Conventional Orientation in the college 
also affected PhD aspiration signifi- 


negatively affected by 
rtfales in the student body, an 


environment. The Social Orientation 


cantly, but the relationship was very complex. A 
liberal arts college appears to increase the student’s 
the PhD, whereas PhD aspiration tends to be reduce 


a 4-year longitudinal 
tion appeared to be 


ttending a coeducational 
motivation to seck 
d as a function of 


attending one of the northeastern men’s colleges. 


pennen 


Studies of differential college effects 
are difficult to design, primarily because 
students are not distributed randomly 
among institutions (Astin & Holland, 
1962; Heist, 1960; Holland, 1959). 
Consequently, variations in student per- 
formance from one college to another 
Probably reflect, at least to some extent, 
differences in their student inputs. This 
problem is further complicated by the 
fact that the independent variable—the 
college environment—is also related to 
the student input (Astin & Holland, 
1961), Under such conditions, the in- 
vestigator runs the risk of finding “ef- 
fects” of college environments which are 
in fact due to variations in student 
Inputs. 

One possible approach to 
Student input is partial correla 
relations between the college environ- 
ment and the student performance are 
obtained, and the contribution of rele- 
Vant input variables partialed out (€.8-5 
eet 
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controlling 
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Astin, 1961). However, if the magnitude 
of the environmental effect is propor- 
tional to the institution’s score on the 
input variable, then the effect will ac- 
count for some or all of the correlation 
between input and student performance. 
Under such conditions, and when the 
institution is used as the unit of sam- 
pling, partial correlation is capable of 
partialing out the institutional effect 
along with the input variable. 

Another approach to the problem of 
differential student input is to match 
students on the relevant input variables. 
But matching is subject to another kind 
of diffculty, namely, the regression ef- 
fect which occurs when subsamples of 
students are selected which are unrepre- 
sentative of their respective college 
populations. This regression effect could 
tend either to produce spuriously posi- 
tive environmental “influences,” or to 
mask real environmental effects. 

The present study attempted to com- 
pare the effects of different college char- 
acteristics on the student’s motivation to 
obtain the PhD degree. However, as an 
alternative approach to partial correla- 
tion or matching, this project employed a 
modification of an input-output design 
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used in a recent study of “PhD produc- 
tivity” (Astin, 1962c). This design be- 
gins by pooling all subjects without 
respect to college attended. On the basis 
of the relevant input variables, an actu- 
arial table is generated in which the cell 
entry represents an “expected” score on 
the student performance. These ex- 
pected scores are obtained from a new 
sample of subjects, and the discrepancy 
between expected and actual perform- 
ances calculated. This discrepancy score 
is then used as the dependent variable in 
the analysis of college effects. 

This method, which will be outlined 
in more detail in the following sections, 
is analogous to the analysis of covari- 
ance. It has the advantage of being able 
to deal with nonlinear relationships, 
categorical predictors, and interactions 
among predictors, but it is more limited 


in that it requires large numbers of 
subjects. 


METHOD 
Subjects 


The sample of 6,544 Merit Finalists and 
recipients of the Letter of Commendation 
from the 1957 National Merit Scholarship 
competition included 4,374 males and 2,170 
females. These subjects had completed a 
mailed questionnaire in the Fall of 1957, 
shortly after enrolling for their freshman year 
in college. The input (predictor) data were 
obtained at that time. A follow-up question- 
naire was administered to these students in the 
Spring of 1961, approximately at the expected 
time of their graduation from college, Since 
80% of the students returned questionnaires 
in 1957, and 78% of them also returned ques- 
tionnaires in 1961, the 6,544 subjects com- 
prise about 62% of the original sample. 


Criterion Measure 


In the follow-up questionnaire the students 
were asked to indicate the highest degree which 
they were seeking (MA, PhD, etc.). Since most 
previous studies of college effects had used 
attainment of the PhD as the dependent vari- 
able, the student’s highest degree sought after 
4 years of college was dichotomized (PhD) 


versus non-PhD), to make the results more 
comparable. All other degrees, including the 
professional degrees, were considered as “non- 
PhDs.” It was also felt that dichotomizing the 
student’s level of aspiration (LOA) in this 
manner would avoid some of the logical prob- 
lems connected with scaling or rank ordering 
the various degrees (Astin, 1962b). 


Procedure 


Cross-validation. From the total sample of 
6,544 students, a cross-validation sample of 
1,908 students was selected for the analyses of 
college effects. The criterion in selecting these 
students was that cach attendéd one of 82 
institutions which enrolled 15 or more students 
from the total sample in the Fall of 1957. In 
order to minimize the contribution of any single 
college to the effects analyses, not more than 
25 students from each college were chosen. 7 
a college enrolled more than 25 G. the 6,544 
students in 1957, the 25 students for the cross- 
validation sample were selected at random. 

The 82 institutions attended by these cross- 
validation subjects were rank-ordered on the 
following college variables: Affluence, Size, 
Masculinity, Private (versus Public) Control, 
Homogeneity, Realistic Orientation, Intellectual 
Orientation, Social Orientation, Conventional 
Orientation, Enterprising Orientation and Ar- 
tistic Orientation. These college variables in- 
clude the eight scales from the Environmental 
Assessment Technique (EAT; Astin & Holland, 
1961), in addition to scores on three other fac- 
tors recently identified in an analysis of 33 
college variables (Astin, 1962a). On the basis 
of their rank order, institutions were grouped 
into seven levels of about equal size separately 
on each college variable. (The Private-Public 
variable, of course, had only two levels.) 
Through this procedure approximately 275 
Students from 11 or 12 different institutions 
were assigned to each of the seven levels of # 
college variable. 

_ Weighting the input variables. The remain- 
ing 4,636 students were used to determine 
weights for the following input variables: 


1. LOA (highest degree sought) in 1957 

2. Sex 

3. Major field of study in 1957 

4. Career choice in 1957 

5. Degree of satisfaction with career choice 
in 1957 (dichotomized as “very satisfied” 
versus all other degrees of satisfaction) 

6. Verbal Aptitude (Scholarship Qualifying 
Test) 

7. Mathematical Aptitude (Scholarship 
Qualifying Test) 
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8. High school percentile rank 

9. High school curriculum (academic, com- 
mercial, etc.) 

10. Number of high school math courses 


taken 

11. Number of scholarships applied for in 
1957 

12. Number of scholarship offers received in 
1957 


13. Distance from home to college 
14. Commuter versus resident in 1957 
15. Father's educational level 
16. Mother's educational level 
17. Father's attitude toward student’s at- 
tending college (four-point scale: “In- 
sists that I go,” “Wants me to go,” 
“Indifferent,” “Doesn't want me to go”) 
18. Mother’s attitude toward student’s at- 
tending college (same as Number 17) 
_19, Number of books in the home 
20. Per-entage of high school peers attend- 
ing college 
21. Father’s occupation 


_ The relationships between each of these 1957 
input variables and the probability of aspiring 
to the PhD in 1961 were determined separately 
by means of actuarial tables. Beginning with 
the most efficient predictor, other input vari- 
ables were added to each cell of the actuarial 
table until cither (a) additional variables no 
longer produced significant changes in PhD 
Probabilities; or (b) the # in the particular 
cell became too small for reliable discrimina- 
tions. For example, it was found that sex and 
initial LOA (degree sought in 1957) were the 
two most effective predictors of 1961 PhD 
aspiration, Accordingly, the subject were first 
Separated into cells on the basis of their sex 
and 1957 LOA. Then, separately within each 
Sex X 1957 LOA cell, all other input variables 
Were applied to determine if further discrimina- 
tions in terms of 1961 PhD aspiration were 
Possible. The subjects in cells with relatively 
large n’s could usually be classified on a greater 
number of additional input variables than the 
subjects in cells with relatively small #’s.? The 
total number of input variables finally used 
to classify each subject ranged from two to 
five. 
~= 

? The .10 level of confidence was 
used in selecting additional input variables. 
However, to reduce the likelihood of Type II 
errors (which in controlling student input 
would be the more serious kind), this level was 
exceeded in a few instances where the cell n 
Was extremely small. 


generally 


Analyses of College Effects 


Students in the cross-validation sample were 
classified on the same input variables used in 
the final actuarial table. All cross-validation 
subjects in a particular cell were assigned an 
input “score” equal to the proportion of PhD 
aspirants in that cell among the subjects from 
the original sample. This value was designated 
as the subject’s probability of aspiring to the 
PhD after 4 years of college. To obtain 
discrepancies between these expected values 
and the subject’s actual performance, a score 
of 1.00 was given to those cross-validation sub- 
jects who actually aspired to the PhD in 1961, 
and a score of O to those who did not aspire 
to the PhD in 1961. Each subject’s expected 
score (probability from the original actuarial 
table) was subtracted from his criterion score 
(1.00 or 0), yielding a discrepancy score. This 
discrepancy score ‘was used as the dependent 
variable in the analyses of college effects. 

In assessing the influence of a given college 
variable on the student’s motivation to obtain 
the PhD, the object was to determine if the 
mean discrepancy score differed as a function 
of different levels on the college variable. How- 
ever, since the distribution of discrepancy scores 
was not normal, an analysis of variance of dis- 
crepancy scores between levels of the college 
variable was not considered to be an appropri- 
ate statistical technique. As an alternative pro- 
cedure, the Kruskal-Wallis H statistic was 
employed. The H is approximately 95% as 
efficient as the single classification analysis of 
variance (Seigel, 1956), but does not require 
normality or homogeneity of variance in the 
dependent variable. 


RESULTS 


Table 1 summarizes the final actuarial 
table. Each row in Table 1 represents 
a cell in the table (i.e., a subgroup of 
subjects classified in given ways on cer- 
tain input variables). The most potent 
predictors of later PhD aspiration turned 
out to be the student’s initial LOA, sex, 
and career choice. However, even when 
these three variables are controlled, the 
student’s degree of satisfaction with his 
vocational choice, his major field, his 
verbal aptitude, whether or not he holds 
a scholarship, and his father’s level of 
education are still related to later PhD 
aspiration in some of the subgroups. 


N 
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TABLE 1 
PROBABILITY OF 1961 PHD ASPIRATION FOR SUBGROUPS CLASSIFIED Ox 
1957 INPUT VARIABLES 
1957 input variable Cross- 
isfied Schol Fath l tabl vaaan 
Satisfie i cholar- 'ather's Actuarial table nos 
; Career i Major i Verbal p = ) 
itial LOA Sex i wi ship i educational (N = 4,636) (N = 1,908 
Tal choice* choice? feld peld? aptitude “dufatio no p n pt 
< Bachelor's F = <= = ‘ — 49 06 8 25 
Bachelor’s F SRorCT — Chemistry — — — 43 126 20. IS 
Bachelor’s F  SRorCT — All others — ee 37 «10 37 «al? 
Bachelor's F Allothers . — Yes aa 131 6 4 14 
Bachelor's F All others — Yes — 219 06 70 10 
Bachelor’s F All others _ Yes = 35 06 5 00 
Bachelor’s F All others ~ No — 86 113 30 «17 
Bachelor's F All others, = - No — 175 ‘os 68 09 
Bachelor’s F Allothes — No — 34 0n 13 0$ 
Bachelor’s M SRocCT — — = = 15 ‘67 3 150 
Bachelor's M SRorCrT — — = = 25 [20 s 150 
Bachelor's M E — = No = = 97 222 41 22 
Bachelor's M_sAllothers — = No — p 133 11 71 18 
Bachelor's M = Allothers — - Yes High 83 135 40 28 
Bachelor's M = Allothes — - Yes Middle 194 133 87 18 
Bachelor's M — Allothers — - Yes Low 39 113 21 05 
Master’s F SRoCT — — Yes = 9 (30 «37 i 
Master's F  SRorCT — - No = 42 V7 30 127 
Master’s F U = - - — 69 “41 32 759 
Master's F  Allothers — = = = = 295 i16 113 013 
Master’s M SRorCT Yes = = = = wm ao B OOB 
Master's M SRorCT No — Yes = = 28 43 10 (40 
Master's M SRorCT No — No = ax 58 66 34 
Master’s M s Ve. 3 24, 
Master's M es ais sA 248 34 103 29 
Mantseg M No = —~< 151.21 52.37 
Master’s M a <= = 47 49 8 50 
Master’s M ie = pana 10841 45 AT 
PhD F = Sa = 169 30 57 26 
PhD F = = = s 111.63 54.65 
PhD M Faas = pa = = 56 50 23 52 
PhD M r ri = bad Collega + i is 77 88 we 
PhD M orCT No s7: = = < College 68 so. 
PhD M S! = = College 4- 120 [60 75.80 
PhD M SR or CT No — — <College 147 151 54 68 
PhD M E = rts Bs si College + 61 159 4 51 
EED M U = = ae — < College 73 49 44 g 
M Alot patis = = es = 150 51 68 
Professional F Te = = = = — 199 ss ao a 
rofessional M — = i Vas En == 1 30 2 ` 
Professional M = = soe. ya = — 155 119 64 14 
Professional M = =, N Ne = — 138 34 59.33 
Unclassified F = = ee > a = 201 16 80 23 
Unclassified M — paa pms Yes — 31 10 6 17 
Unclassified M = = z s = = 20 50 nmo AS 
No = — 23 126 7 29 
* Career choices have been abbrevi. tanti in San y 
neer; HST, High School Teacher; S' eviated as follows: SR, Scientific Researcher; CT, College Teacher; E, Engi- 


Proportion of subjects aspiring to the PhD in 


The cell with the highest rate of PhD 
aspiration in 1961 (77%) consisted of 
176 males who initially aspired to the 
PhD in 1957, who had chosen either 
college teaching or scientific research for 
a career, who were well satisfied with 
their career choice, and whose fathers 
were themselves college graduates. The 
cell with the lowest rate of PhD aspira- 
tion in 1961 (0%) consisted of 34 fe- 
males who initially aspired to the bache- 
lor’s degree, who had chosen a career 


W, Social Worker; U, Undecided. 
1961, 


other than either scientific research or 
college teaching, who were of relatively 
low verbal aptitude, and who did not 
hold a scholarship. (These two extreme 
groups had 1961 PhD aspiration rates 
of 76% and 08%, respectively, in the 
independent cross-validation sample.) 

_ Figure 1 shows the input probabili- 
ties from the initial sample applied to 
the entire cross-validation sample. Dis- 
tributions of Probabilities clearly sepa- 
rate those who actually aspired to the 


Cortecs EFFECTS ON 


PER CENT IN EACH INTERVAL 
a 


PRODADILITY INTERVAL (PHOS ACTUARIAL TABLE) 


; Fic. 1. Discrimination between PhD aspir- 
ants and non¢PhD aspirants in the cross-vali- 
dation sample. 


PhD in 1961 from those who did not. 
If the a priori optimal cutting score of 
„50 is used, the overall accuracy of iden- 
tification after 4 years is 749 in the 
cross-validation sample. Fifty-four per- 
cent of the PhD aspirants are correctly 
identified, and 84% of the non-PhD 
aspirants. Lowering the cutting score 
in the cross-validation sample to the a 
Priori base rate (.33) correctly identifies 
74% of the 1961 PhD aspirants and 
65% of the 1961 non-PhD aspirants. 
The overall rate of accuracy, however, 
is reduced from 74% to 68% with this 
lowered cutting score. 

Despite the relatively high relation- 
ships found between the input variables 
and later PhD aspiration, it is possible 
that certain other relevant input varia- 
bles may not have been controlled. Since 
the 21 variables which were tried are 
Primarily concerned with educational 
and vocational plans, aptitude, and so- 
Cloeconomic factors, perhaps the most 
likely sources of uncontrolled input vari- 
ance are personality variables. A chance 
to examine this possibility was afforded 
by the fact that, prior to entering col- 
lege in 1957, about one-sixth of the sub- 
jects had taken two personality in- 
Ventories: the California Psychological 
Inventory (CPI; Gough, 1957); and the 
Inventory of Beliefs (IB; Stern, Stein, 
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& Bloom, 1956). Since Holland (1959) 
had shown previously that several scales 
from the CPI and IB are related to char- 
acteristics of the college chosen by the 
student, it was considered particularly 
important to determine if these scales 
were also related to the dependent vari- 
able used in the present study. 

Using the 304 cross-validation sub- 
jects for whom CPI and IB scores were 
available, the PhD discrepancy scores 
(1.00 or O minus the input probability) 
were ncrmalized and correlated with 
each of the inventory scales. None of 
the 20 coefficients (18 for the CPI and 
2 for the IB) was significant (p=.05), 
results which suggest that personality, 
in CPI and IB terms, was not a major 
source of uncontrolled input variance. 

Results of the analyses of effects of 
the 12 college variables are presented in 
Table 2. Four of these variables (Size, 
Percentage of Males, the Social Orienta- 
tion, and the Conventional Orientation) 
appear to have significant effects on the 
student’s PhD aspiration. Plots of these 


TABLE 2 


ANALYSES OF COLLEGE EFFECTS ON 
PuD ASPIRATION 


x? 
College variable dj (Kruskal- 
Wallis H) 
‘Affluence 6 4.64 
Size (Total Enrollment) 6 26.31*** 
Maculinity I* 6 7.78 
Masculinity II (Percentage 
of Males) 6 37,.294** 
Homogeneity 6 12.58 
Private versus Public 1 2.12 
Realistic Orientation 6 11.31 
Intellectual Orientation 6 5.68 
Social Orientation 6 21.00** 
Conventional Orientation 6 15.77* 
Enterprising Orientation 6 4.88 
6 9.74 


Artistic Orientation 


1 Orientation minus the Social and 


a The Conventional i 
(from Astin, 1962a). 


Artistic Orientations 
X .02. 
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Fic. 2. Expected and actual percentages of 
PhD aspirants at each of seven levels on four 
college variables. 


four variables are shown in Figure 2. 
Expected percentages of PhD aspirants 
for each of the seven levels of the four 
college variables have been computed 
by averaging the expected probabilities 
for the subjects in each level and mul- 
tiplying by 100. The magnitude of the 
effect at any level of a college variable 
is indicated by the difference between 
the expected percentage (broken line) 
and the actual percentage (solid line), 
Size, Percentage of Males, and the 
Conventional Orientation tend to have a 
negative effect on PhD aspiration (ies 
expected percentages of PhD aspirants 
tend to exceed the actual percentages at 
higher levels on these variables, whereas 
at the lower levels the actual percentages 
exceed the expected percentages). How- 
ever, the greatest differences between 
expected and actual percentages do not 
always occur in the extreme intervals of 
these college variables. Results with the 
variable, Percentage of Males in the 
Student Body, are of special interest, 
Colleges in both the first and second 
categories on this variable appear to have 
a facilitative effect on the student’s PhD 


aspiration. However, the effect seems to 
be at least as pronounced in the second 
category (coeducational institutions with 
about equal proportions of males and 
females) as in the first category (wom- 
en’s colleges). The effect in this second 
category was similar for both sexes, with 
the actual PhD aspiration rates for both 
males and females being about 1.4 times 
their expected rates. The actual PhD 
aspiration rate for females in Category 
1 (women’s colleges) was about 1.3 
times the expected rate, (It is impor- 
tant to note that adjusted PhD aspira- 
tion was not also related to Masculinity 
defined as the Conventional Orientation 
minus the Social and Artistic Orienta- 
tions. Apparently the two different 
methods of scoring Masculinity are not 
equivalent.) 

The Social Orientation appears to 
have a complex, nonmonotonic relation- 
ship to PhD aspiration, with the largest 
Positive and largest negative effects oc- 
curring in adjacent intervals. 

In view of the evidence that there 
are differential college effects on the 
student’s PhD aspiration, an attempt 
was made to relate these findings to a 
recent study of PhD “productivity” 
(Astin, 1962c). In this latter study, the 
proportion of graduates at each of 265 
institutions who later obtained the PhD 
was determined. These “actual” PhD 
outputs were then compared with “ex- 
pected” PhD outputs based on three stu- 
dent input variables: sex, intelligence, 
and major field of study. Under these 
conditions, public institutions were 
found to be significantly “overproduc- 
tive,” and colleges for men located in 
the Northeastern states were signifi- 
cantly “underproductive.” 

From Table 2 it appears that the pri- 
vate and public institutions in the pres- 
ent study did not differ in the extent to 
which they affected the student’s PhD 
aspiration. Possible reasons for this 
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discrepancy in the results of the two 
studies are: (a) that a larger and more 
heterogeneous sample of institutions was 
used in the earlier study, (b) that differ- 
ences in student input may not have 
been adequately controlled in the earlier 
study, or (c) that the student's stated 
PhD aspiration at college graduation 
does not predict attainment of the PhD 
with complete accuracy. 

To re-examine the underproductivity 
of the Northeastern men’s colleges re- 
ported in the earlier study, students at- 
tending these same colleges were identi- 
fied in the cross-validation sample and 
compared with all other students by 
means of the Kruskal-Wallis analysis. 


Students attending two other subgroups 
of institutions—technological institu- 
tions and liberal arts colleges—were also 
identified and similar analyses per- 
formed. (Those latter two groups tended 
to be overproductive in the earlier study, 
although the differences were not sta- 
tistically significant.) Table 3 shows the 
results of these additional analyses. The 
actual proportion of PhD aspirants at 
the Northeasterh men’s colleges fell 
short of the expected proportion ($ < 
.001), a result which supports the finding 
of the earlier study. Technological in- 
stitutions did not differ significantly 
from the others in the analysis, but the 
coeducational liberal arts colleges, when 


TABLE 3 


EFFECTS OF THREE DIFFE 


RENT TYPES OF INSTITUTIONS ON THE 
STUDENT’S PHD ASPIRATION 


Number of percentage percentage dj 
students 


Type Institution 


Expected Actual x? 
(Kruskal- 
pup Wallis 7) 


aspirants 


of PhD 
aspirants 


Northeastern 
men’s 
colleges 


Amherst 

Dartmouth 

Harvard 

Princeton 

Wesleyan 

Williams 

Yale 

Auburn 

California Institute of 
Technology 

Case Institute of Technology 

Georgia Institute of 
Technology 

Illinois Institute of 
Technology 

Massachusetts Institute of 
Technology 

Rensselaer 

Rice 

Antioch 

Carleton 

Grinnell 

Oberlin 

Pomona 

Reed 


Technological 
Institutions 


Cocducational 
liberal arts 
colleges 


167 41.28 


201 39.65 


162 39.64 


34.13 1 14.20" 


37.81 1 1.61 


59.26 1 29,634 


Swarthmore 


"* p< 001. 


70 ALEXANDER 


compared with other institutions, turned 
out to have a marked positive effect (p 
< .001) on the student’s PhD aspira- 
tion. 

The difference between the effects of 
these types of institutions is consider- 
able when it is realized that, even though 
the Northeastern men’s colleges have a 
slightly higher expected rate of PhD as- 
pirants than the coeducational liberal 
arts colleges (41% versus 40%), the 
actual rate of PhD aspirants in the co- 
educational colleges is considerably 
higher (59% versus 34%). Why these 
types of institutions should have such 
different effects is difficult to determine. 
Both groups are composed of institutions 
which are highly affluenc and which have 
outstanding reputations. It could be that 
the climates at the Northeastern men’s 
colleges encourage the student to pursue 
careers in business and the professions 
rather than in teaching or research. The 
coeducational liberal arts colleges, in 
contrast, may communicate to their stu- 
dents a greater bias toward scientific or 
academic fields. These same liberal arts 
colleges, it should be noted, tend to 
combine several of the college character- 
istics which are positively related to PhD 
aspiration: small student bodies with 
about equal numbers of males and fe- 
males, and relatively low Conventional 
Orientations. Just how these college 
characteristics interact to affect student 
motivation is, of course, unknown. In 
any case, a more intensive study of the 
environments at these institutions would 
seem to be indicated. 

Separate checks on the expected and 
actual PhD aspiration rates of male and 
female students again did not indicate 
that these college effects interact with 
sex. In the coeducational liberal arts 
colleges, the actual PhD aspiration rates 
for both males and females were 1.5 
times greater than their expected rates. 


W. Astin 


Discussion 


In any quasi-experimental work like 
the present study, there remains the pos- 
sibility that the significant results are 
due to uncontrolled input variables, 
rather than to differential influences of 
the institutions. However, since a va- 
riety of input variables were controlled 
using a large sample of subjects, and 
since adjusted PhD aspiration scores 
were found to be independent of the 
20 personality scales, it is unlikely that 
the marked differences fovnd between 
expected and actual PhD aspiration rates 
are not in part the result of different 
environmental influences. 

The design used in this project is 
probably suitable for the study of college 
effects on a variety of other student be- 
haviors. However, in cases where (a) it 
would be feasible to regard all input 
variables as continuous variables, and 
(b) interactions among predictors were 
not a major source of variance, there is 
probably something to be gained in terms 
of efficiency by using multiple regression 
instead of the actuarial table. 

It would seem from the results of this 
study that the effects of college charac- 
teristics on student motivation to seek 
the PhD are exceedingly complex. None 
of the college variables appeared to have 
simple additive effects, and the effect 
of at least one (the Social Orientation) 
was clearly nonmonotonic. The fact that 
a priori groups of colleges (i.e., North- 
eastern men’s colleges and coeducational 
liberal arts colleges) showed the most 
pronounced differential effects naturally 
raises the question as to whether it 
would eventually be more fruitful to 
study combinations or configurations of 
college variables. 

The difficulty encountered in inter- 
preting these significant college effects 
indicates that a more intensive study of 
student-college environment interactions 
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is necessary. The gross college variables 
used in this study (i.e. the EAT and 
‘the factored dimensions) should con- 
tinue to be useful in identifying differ- 
ential college effects, but a more mean- 
ingful interpretation of such effects will 
depend ultimately on our ability to de- 
scribe the college environment in terms 
of the experiences of the individual 
student. 
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The 264 Illinois high school students studied a passage presenting 3 


Southern interpretation of the Civil War. 
the Civil War period was held constant 
sign, the differential effect of attitudinal 


When general knowledge about 
in an analysis of covariance de- 
bias on retention was eliminated. 


Tais finding suggests that it is the lack of appropriate subsuming con- 


cepts in attitude structure, 


tors on retention processes, that renders 
her substantiating the greater relative im- 


ere the facts that the more knowledgeable 


susceptible to forgetting. Furt 
portance of cognitive factors W 
Ss learned more than 
passage facilitated retention. 


rather than the direct effect 


the less knowledgea! 


of affective fac- 
“other side” arguments more 


ble Ss. and that an organizing 


——————— 


The phenomena of selective learning 
and ‘selective forgetting of material in- 
volving ego threat has been consistently 
interpreted in terms of affective mech- 
anisms operating directly on the learning 
and forgetting processes (Edwards, 
1941: Gustafson, 1957; Taft, 1954). 
Implicit in the interpretive use of affec- 
tive mechanisms is a denial of the im- 
portance of cognitive factors in selective 
learning and retention. However, de- 
Spite widespread use of the notion of in- 
trinsic motivational factors in explaining 
these phenomena, no research to date 
has unequivocally established the oper- 
ation of “defense” or “repression” mech- 
anisms in the learning and retention of 
Meaningful material which conflicts with 
the learner’s prevailing attitude struc- 
ture. ‘ 

On the other hand, the dependence of 
learning and retention on cognitive vari- 
ables has been clearly established (Ausu- 


1 This paper is based on a dissertation of the 
same title by the principal author, submitted 
mate Graduate College of the University © 

linois, in partial fulfillment of the require- 
ments for a PhD in educational psychology- 
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bel & Blake, 1958; Ausubel & Fitzger- 
ald, 1962). The learning and retention 
of meaningful noncontroversial material 
have been shown to be directly re- 
lated to the learner’s subject-matter 
sophistication (Ausubel & Blake, 1958; 
Ausubel & Fitzgerald, 1962). When ex- 
isting cognitive structure is generally 
devoid of subsuming concepts relevant 
to the learning task, the novel material 
is poorly learned and rapidly forgotten. 
This line of research suggests a more 
parsimonious interpretation of “selective 
forgetting” than the concepts of defense 
and repression. In learning “other side” 
arguments, the conceptual schema con- 
stituting the cognitive dimension of atti- 
tudes is usually devoid of relevant sub- 
suming ideas to which the new material 
can be functionally related. The ma- 
terial, therefore, cannot be readily an- 
chored to cognitive structure, competes 
with existing meanings, and is conse- 
quently ambiguous and subject to rapid 
forgetting. In the case of positive atti- 


tudinal bias, it seems reasonable to sup- 


pose that the cognitive dimension of atti- 


74 DoxarD FITZGERALD AND Dayip P. AUSUBEL 


tude structure contains more relevant 
and appropriate subsuming concepts 
than in the case of negative bias. Hence 
the material can be readily anchored to 
cognitive structure, need not compete 
with existing meanings, and is therefore 
less ambiguous and less subject to for- 
getting. Attitudinal bias might conceiv- 
ably facilitate or inhibit the learning of 
controversial material by generally rais- 
ing or lowering levels of effort and 
concentration. However, once material 
is learned, it seems more reasonable to 
attribute differential rates of forgetting 
to cognitive variables. 

In order to differentiate experimen- 
tally the respective effects of the cogni- 
tive and affective components of attitude 
on learning and retention in this re- 
search, attitude structure is analyzed in 
terms of the direction and intensity of 
attitudinal bias (i.e., the affective di- 
mension) and the extensiveness and clar- 
ity of the related conceptual schema (i.e., 
the cognitive dimension). An attitude, 
therefore, is here considered a structure 
of ideas which involves organization 
around a conceptual nucleus and which 
has affective properties (Peak, 1955). 
That is to say, an attitude involves both 
affective and cognitive components. Any 
meaningful concept or conceptual sys- 
tem which an individual internalizes will 
be related in some way, along a negative- 
positive continuum, to his ego structure. 
What we are here calling an attitude is a 
conceptual nucleus whose evaluative di- 
mension is either highly positive or 
highly negative from an affective stand- 
point. The term “cognitive structure” 
as used in this paper is synonymous with 
the cognitive dimension of attitude. In 
contrast to this cognitive component, the 
phrase “affective components” refers to 
the complex of feelings that a particular 
organization of cognition or perception 
induces in the subject. 

Using this affective-cognitive analysis 


of attitudes, the main purpose of con- 
ducting the experiment reported here 
was to re-examine the effect of attitudes 
on the learning and retention of contro- 
versial material in an attempt to de- 
termine the relative contributions of 
cognitive and affective variables to the 
learning-forgetting process. Concurrent 
with this analysis, the efficacy of a brief 
introductory passage (an “organizer”’) 
in facilitating the learning and reten- 
tion of controversial materials 
tested. 

In the present study the following 
hypotheses were tested: (a) The clarity 
and stability of cognitive structure is 
positively related to the learning and re- 
tention of controversial material. (b) 
Positive attitudinal bias facitities, and 
negative attitudinal bias inhibits, the 
learning of controversial material, (c) 
Attitudinal bias has no effect on the 
retention of controversial material. (d) 
The learning and retention of controver- 
sial material is proactively facilitated by 


the introduction of a relevant compara- 
tive organizer. 


was 


METHOD 
Subjects and Learning Passage 


Since one purpose of this study was to dem- 
onstrate the feasibility of controlled classroom 
experimentation in this area, 264 junior stu- 
dents of an Illinois high school 2 were used as 
subjects, and the learning material was related 
to a traditionally presented unit in United 
States history. j 

The experiment was conducted separately in 
each of 16 American history sections, as 00€ 
unit in a sequence dealing with the causes of 
the Civil War. The learning passage consisted 
of a 2,900-word Southern interpretation of the 
causes of the Civil War. The material pre- 
sented a general theme of Northern aggression 
and acts of violence against the South and, 
in particular, condemned the Lincoln adminis- 
tration, The regular class unit preceding the 


? The cooperation of the Social Studies De- 
partment of Champaign Senior High School i$ 
gratefully acknowledged. 
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experiment considered the same topic as the 
earning passage but from a Northern point of 
view. The Southern interpretation was un- 
familiar to the subjects and was selected be- 
cause it conflicted with the culturally biased 
Suen of this historical period to which 
D orthern students are continually exposed. By 
using material which interpreted known facts 
in an unfamiliar controversial way, it was 
possible both to estimate the clarity and ex- 
tensiveness of the cognitive dimension of atti- 
tude structure (by a pretest covering factual 
knowledge of the period) and yet to retain 
the unfamiliarity of the learning passage. 


Test on the Learning Passage 


i hea of the Civil War passage was 
es ed by a 34-item multiple-choice test (five 
po with a split-half reliability of .77. 
F a test was used for measuring both learning 
and retenticn. Test questions generally covered 
points of dispute between Northern and South- 
ron interpretations, the five responses being 
Sa along a continuum from an appropri- 
ma lorthern response to a response most ap- 
To priate in terms of the learning passage. 
at Sole: that subjects responded in terms 
pest ar earning passage, the test directions re- 
Bali the instruction that the response selected 
with tt be the one that seems most consistent 
psa he ideas and point of view presented in 
an pee Test questions were selected by 
S em analysis from a larger population of 
items. 

on learning and retention scores on the 
aa owed a satisfactory range of variability 
Gi oe distributed normally, It was found 
mya em analysis that eight responses could be 
FES n a secondary weighting. Correct primary 
oon were given a weight of 2, and correct 
1 ndary responses were given a weight of 
Siete making a maximum score of 63. 
ti e the test was intended as a power test, nO 

me limit was imposed. 


Attitude Inventory 


A 20-item attitude inventory was prepared 
to measure the direction and intensity of atti- 
tudinal bias toward Southern actions during 
the era preceding the Civil War. The inven- 
tory consisted of controversial statements 
directly related to the content of the learning 
peace The 20 items were selected from a 
arger population of items on the basis of & 
group of expert ratings (senior undergraduate 
students majoring in social studies) of the 


~ 
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statements as indicative of either strong North- 
ern or Southern bias. Only items at the 
extremes of the judgmental scale which mani- 
fested little or no variability in the ratings 
received were chosen. Approximately half the 
items selected were indicative of the Northern 
bias, and half were indicative of Southern bias. 

Subjects were asked to rate the items in 
terms of their own agreement, disagreement, 
strong disagreement, strong agreement, or un- 
certainty regarding the sentiments expressed 
in the various statements. The responses were 
weighted from one to five (five indicating 
strong Northern bias), and a total attitude 
score Was determined by summing the item 
scores and dividing by three (for purposes of 
computation). 

Apart from their self-evident face validity as 
a measure of Northern-Southern bias, an em- 
pirical check, carried out with an independent 
group of subjects, showed that 2 correlation 
of 54 (p < .001) existed between attitudinal 
bias scores and intensity of acceptance or rejec- 
tion of the passage. The group of students 
used in validating the inventory was a repre- 
sentative sample of junior year students who 
could not be used in the main experiment be- 
cause of a schedule conflict. The mean attitude 
score of the group responding to the passage 
in a neutral manner was 22. 

The attitude scores showed a satisfactory 
degree of variability and were normally dis- 
tributed. Since the mean attitude score of 
subjects in the middle-third of the subgroup 
distributions was not significantly different 
from the established neutral point of 22, the 
upper-third, middle-third, and lower-third at- 
titude groups were described, respectively, as 
negatively biased, neutral, and positively biased 


toward the Jearning passage. 


Test of Verbal Reasoning 


The Verbal Reasoning test (Form A) of the 
Difierential Aptitude Test (DAT) battery was 
used as a measure of the subject’s ability to 
abstract, to generalize, and to understand ver- 
bal concepts. Approximately 75% of the ex- 
perimental population had test scores on file. 
The DAT Verbal Reasoning test was admin- 
istered to the remaining 25% immediately 
after the experimental sequence. 


Introductory Passages 

uctory passages were 
each about 450 words 
ental group studied a 


Two types of introd 
used in this experiment, 
in length. The experim! 
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comparative organizer which explicitly pointed 
out, at a high level of abstraction, generality, 
and inclusiveness, the principal differences be- 
tween the Northern and Southern Positions 
on the causes of the Civil War. The ideas in 
the comparative organizer were Presented at 
a much higher level of generality and inclu- 
siveness than the learning passage itself, and 
were deliberately constructed to increase dis- 
criminability between the two sets of con- 
cepts. The control introduction discussed the 
history of Civil War interpretations and the 
possibility of the same events being interpreted 
in many different ways depending upon the 
perspective of the historian, but it contained 
no substantive material about these-interpreta- 
tions. This control introduction served two 
important functions. First, it was methodologi- 
cally important to provide a control introduc- 
tion in order that any obtained differences in 
learning and retention outcomes between the 
experimental and control groups could be at- 
tributed to the particular nature of the or- 
ganizer (i.e. to its enhancing effects on dis- 
criminability) rather than to its presence 
per se. Second, an organizer could conceivably 
facilitate learning and retention of contro- 
versial materials by reducing the negative bias 
that induces selective learning. Since one 
principal purpose of this study wa 
rate the effects of cognitive and aff 
tors on the learning and retention of contro- 
versial material, it was necessary to provide a 
control introduction that equated the two 
groups on “affective set,” leaving the cognitive 
effects of the Organizer “free” as an inde- 
pendent variable, 
Neither introduction provided any informa- 
tion that could be used in answering the test 
questions on the learning passage. 


s to sepa- 
ective fac- 


Procedure 


The experimental sequence began immedi- 
ately following the completion of the unit of 
study on the events leading up to the Civil 
War. On the day preceding Session 1, the sub- 
jects were informed that some people from the 
Bureau of Educational Research would be 
working with them on the pre-Civil-War 
period. Every attempt was made to have the 
teachers feel that the material to be studied 
was relevant to their purposes. It was sug- 
gested to the teachers that the results of the 
pretest on the pre-Civil-War period could be 
used for grading purposes if they so wished, 
and that the scores on the pretest as well as 
on the retention test would be made available 
to them. 


Session 1. During Session 1, all subjects 
took the attitude inventory (8 minutes) and 
the pretest, and then (after assignment to a 
treatment group) studied either the organizer 
or the control introduction for 8 minutes. 
Membership in a treatment group was deter- 
mined by random assignment. The population 
of each of the four treatment groups (i.e. 
experimental learning, experimental retention, 
control learning, and control retention) was 
also stratified by sex so that the proportion 
of males to females would be the same in each 
group. This was necessary because of the pos- 
sibility that female subjects might possess 
higher DAT scores. It was possible to admin- 
ister both treatments simultaneously because 
they consisted of identical appearing intro- 
ductory Passages (with identical sets of direc- 
tions) differing only in content. 

To control for the effects of different teacher, 
test administrator, and classroom climate vari- 
ables in the 16 sections, the subjects within 
each section were equally divided ‘among the 
four treatment groups, Since analysis of the 
data showed that homogencity of variance 
prevailed, both on an interclass and inter- 
group basis for the Civil War pretest, attitude 
inventory, and learning and retention tests it 
was considered justifiable to treat the scores 
of the four treatment groups on each of these 
instruments as random samples from the same 
population. 

Session 2. The day after Session 1, all sub- 
jects read and studied for 28 minutes the learn- 
ing passage presenting the Southern point of 
view, Immediately after studying the passage, 
the experimental and control “learning” groups 
took the 34-item test on the passage, At the 
same time the experimental and control “re- 
tention” groups took an irrelevant test on 
Christianity in order to equate the learning 
and retention groups on procedure. (The topic 
of Christianity was chosen as maximally dis- 
similar to the learning Passage, and therefore 
least likely to induce retroactive interference.) 

Session 3. Seven days after Session 2 all 
Subjects took the test on the passage as a test 
of retention. The learning groups’ scores on 


this test were not considered in the retention 
analysis. 


RESULTS AND Discussion 


Effect of the Organizer on Learning and 
Retention 


As hypothesized, the organizer treat- 
ment was Significantly effective in facili- 
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TABLE 1 


ANALYSIS OF VARIANCE OF PRETEST LEVELS X 
TREATMENT X RETENTION 


: Source dj SS MS F 
Treatment 14 O 7 
hee 1 417 417 moe 
Pretest levels $ 12800 ojis gages 
Retention 1 4483. sios 623% 
Freatment X pretest 2 203 147 204 

menen X retention 1 e 
Pretest X retention 2 5 2.82* 
Treatment X pretest X eS is 
„ Fetention 2 302 151 2.09 
ran 252 18082 72 
‘otal 2635 36873 
Raines Seen hl ietiothses concerning homogeneity of 
WERA 
tee bs 05 
P< OL 


tating learning and retention of contro- 
versial material (F=5.79, p < .05; see 
able 1). Moreover the beneficial effect 
A the organizer was further demon- 
a by the significant treatment effect 
that emerged (a) when an analysis of 
nr of attitude levels x treat- 
j: nt X retention was performed with 
i AT held constant (F=6.15, p < .01; 
fone 2), and (b) when an analysis 
ane of pretest levels X treat- 
San X retention, holding DAT con- 
$ , Was performed (F=6.98, p < .01; 
see Table 3). However, when an analy- 


st 


x 


AND RETENTION 


sis of covariance of attitude levels x 
treatment X retention was carried out 
with pretest held constant, the treatment 
effect was not significant (see Table 4). 
Hence it can be reasonably inferred that 
much of the positive treatment effect 
evident in the preceding two analyses 
could be attributed to the interaction (in 
a nonstatistical sense) between the or- 
ganizer and what we have called the cog- 
nitive dimension of attitude structure. 
Although there was a tendency for the 
experimental group to be superior on 
learning, most of the benefit derived 
from the organizer was manifested in 
relation to retention rather than to learn- 
ing. When subgroup means of learning 
were corrected for their dependence on 
DAT, there were no significant differ- 
ences between treatment pairs of upper- 
third, middle-third, and lower-third or 
combined pretest levels (means are given 
in Table 5). However, comparable cor- 
rected retention means indicated a sig- 
nificant difference between the treat- 
ment means of the combined levels 
(623i, p=.03; see Table 5 for cor- 
rected means), as well as a significant 
difference between the treatment means 
in the upper-third pretest level (t= 2.88; 


TABLE 2 


ANALYSIS or COVARIANCE or ATTIT 


vpe LEVELS X TREATMENT x 
DAT CONSTANT 


Retention HOLDING 


Adjusted 
Source df SSy SP SS+ ne uF F 

Treatment i 417 957 59 492-1 q 6r 
Attitude levels 2 67 732 23192 167 a 84 105 

etention 1 4483 590 37 4216 1 1216 152** 

treatment X attitude 2 33 M 151 201 2 146 18 
Ae cnt X retention 1 1 =6 1970 106 1 106 133 

ttitude X retention 2 239 110 4074 399 2 200 250* 
s Satment X bias X retention 2 339 636 1340 us 2 5 

a 252 30330 45282 197778 19962 251 80 

Total 263 36873 50428 228641 25751 262 

e iance and regression accepted. 


Note—Null hypotheses concerning homogeneity of var! 


“pe E 
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TABLE 3 
v RETENTION HOLDING 
Š, F COVARIANCE OF PRETEST LEVELS X TREATMENT x 
ANALYSIS OF Co PAE 
— T ss, Adjusted 
Source dj SSy SP S y a MS F 
= as = -— -—— — ae 
Tre 1 417 44 O 247 433 1 43 6.98% 
Pete els 2 12890 30278 79882 11568 2 5784 93377 
pais os 1 4483 680 103 4302 1 4302 694 
‘Treatment X pretest 2 293 347 317 207 2 104 1.68 
Treatment X retention 1 1 —5 1587 30 1 30 siar 
Pretest X retention 2 405 —172 256 455 2 228 os 
Pretest X treatment X retention 2 302 654 1678 158 2 79 E 
Error * 252 18082 18970 144242 15587 251, 62 
Total 263 36873 50708 228312 25611 262 


Note.—Null hypotheses concerning homogeneity of variance and regression accepted. 
igs 05. 


*.p 20l. 


ANALYSIS OF COVARIANCE OF ÅTTITUDE INvEN: 
HOLDING PRETEST CONSTANT 


TABLE 4 


TORY LEVEL 


X TREATMENT X RETENTION 


Adjusted 
df SS, SP SSeS o 
Source 1 y x SS, aj MS F f 
Treatment 1 417 268 172 118 1 118 17% 
Attitude inventory level 2 671 1237 2283 72 2 36 < 
Retention 1 4483524 61 3745 1 3745 551 
Treatment X attitude inventory 3 393 260 273 159 2 80 1.18 
Treatment X retention 1 1 -1 34 20 E 20 
Attitude inventory X retention 2 239 73 114 193 2 97 1.43 
Treatment X retention x 
attitude inventory 2 339 299 375 103 2 52 
Error 252 30330 18357 25261 16990 251 68 
Total 263 36873 21017 28573 
poles Null hypotheses concerning homogeneity of variance and regression accepted. 
TABLE 5 
MEANS or PRETEST LEVELS ON LEARNING AND RETENTION CORRECTED ror DAT 
Learni i 
Pretest “mal a M — Retention M 
h Xperi- , Experi- ota 
level Tiental Control Total EA E Control T 
Upper-third 36.7 34.7 35.7 27.9 21.1 A 
Middle-third 27.0 22.6 24.8 16.9 15.2 wa 
Tower:tlird 21.1 21.9 21.5 16.9 16.2 me 
Combined 28.3 26.3 27.3 20.6 17.5 19. 


Note.—N for each subgroup is 22. 
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p=.007). This latter result is in con- 
trast to the findings of a previous study 
in which Ausubel and Fitzgerald (1961) 
found that organizers differentially bene- 
fit subjects with a limited and diffuse 
cognitive structure. The discrepancy can 
probably be explained by the nature of 
the learning tasks involved in the two 
studies. 

In the Ausubel and Fitzgerald (1961) 
study, the learning task dealt with ma- 
terial which, although unfamiliar in ter- 
minology, was directly relatable and in 
- many ways similar to concepts already 
established in cognitive structure. The 
learning passage dealt with the prin- 
ciples of Mahayana Buddhism, and the 
organizer presented Buddhism as a cate- 
gorical variant of Christianity. The 
comparative organizer, in other words, 
presented an organized structure of 
Buddhist concepts in terms of Christi- 
nee thereby clarifying and reinforcing 

ne main principles of Christianity as 
well as introducing Buddhism. The or- 
eo could therefore be expected to 
coma most those subjects whose knowl- 
ett Christianity was unclear, by first 
diffe ying Christianity concepts before 
Pi iting them from Buddhism. 
Ba her with an extensive and clear or- 
ew of Christianity, on the other 
ay could be expected to formulate 
ond own differentiations within the 
ie ra task itself, and would thus de- 
met oo benefit either from the pre- 
of i „contrasts or from the discussion 
a ristianity given in the organizer. In 

e present study, however, the ideas 
Presented in the learning passage Were 
concepts which directly conflicted with 
existing ideas in cognitive structure 
rather than constituting variations of 
existing ideas. Whereas the learning 
task in the previous study tended to T°- 
inforce the existing structure of knowl- 
edge, the present study was designed to 
induce cognitive dissonance and affec- 


tive stress. In the latter circumstances 
the data clearly indicate that a prerequi- 
site condition for deriving benefit from 
the organizer is a clear stable cogni- 
tive structure of ideas. In a recent study 
in which the learning task (endocri- 
nology of pubescence) was not directly 
relatable to general background knowl- 
edge in endocrinology, there was a simi- 
lar tendency for the organizer to benefit 
differentially those subjects with the 
higher general endocrinology scores 
(Ausubel & Fitzgerald, 1962). 


Effect of Cognitive Variables on Learn- 
ing and Retention 

The data clearly established the gen- 
eral dependence of learning and reten- 
tion on pretest scores. In a pretest levels 
x treatment X retention covariance 
analysis holding DAT constant, the sig- 
nificant effect of pretest levels was 
readily apparent (F=93.3, p < .01; see 
Table 3). However, a significant first- 
order interaction between pretest levels 
and retention indicated that the effects 
of the independent variable differed from 
learning to retention. From Table 5 
it can be seen that this interaction is 
largely a reflection of the fall off from 
learning to retention in the upper-third 
pretest level (difference between means 
of 11.2) in contrast to the much smaller 
difference in the lower-third pretest level 
(difference between means of 4.9). Ap- 
parently the tendency for the more 
knowledgeable subjects to manifest a 
relatively higher rate of forgetting than 
the less knowledgeable subjects is a 
function of the greater ideational incom- 
patibility (cognitive dissonance) of the 
new material with established knowl- 
edge in the former instance. Thus, al- 
though a clear and stable cognitive 
structure enables the subjects to learn 
antithetical new material more readily, 
this material, once learned, is more 
rapidly reduced during the retention in- 
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terval to the original, established propo- 
sitions in cognitive structure than when 
existing ideational structure is less clear 
and stable. Supporting evidence of the 
long-term inhibitory effect of cognitive 
dissonance on retention is seen in the 
significant inverse relationship of .30 
(p < .01) between degree of pro-South- 
ern attitude and pretest scores: idea- 
tional conflict between existing pro- 
Southern bias in the individual, on the 
one hand, and the general pro-Northern 
cultural bias in the Northern community, 
on the other, tends to render knowledge 
about the Civil War period less stable 
than when the individual shares the cul- 
tural bias. The higher rate of forgetting 
in the more knowledgeable group of sub- 
jects also explains in part why the or- 
ganizer has more of an effect on retention 
than on learning, and why it differen- 
tially benefits the subjects with higher 
pretest scores. 

Further evidence of the dependence of 
learning and retention on pretest scores 
is provided by simple and partial corre- 
lations. Simple correlations between pre- 
test and learning scores (r=.67, p < 
01) and between pretest and retention 
scores (r=.59, p < .01) still remained 
significant when corrected for their de- 
pendence on DAT scores. The partial 
correlation between pretest and learning 
with DAT eliminated (r=.47, p=.01) 
was not significantly different from a 
similar partial correlation between pre- 
test and retention (r=.41, p <.01). A 
similar analysis of DAT by learning and 
retention indicated a correlation of .68 
(p <.01) between DAT and learning 
which was reduced to .49 (p< 01) 
when pretest was partialed out, and a 
correlation of .59 (p < .01) between 
DAT and retention which was reduced 
to .22 (ws) when the effect of the pre- 
test was eliminated (see Table 6). 
Therefore it seems that although the 
clarity and stability of cognitive struc- 


TABLE 6 


PARTIAL CORRELATIONS OF Pretest AnD DAT 
Scores WITH LEARNING AND RETENTION 


Scores 
Partial Test a 
correlation Learning Retention 
Pretest 2 AT* 41* 


DAT» Ag* 22 


a DAT eliminated, 
» Pretest eliminated. 
* ps os 


ture are significant varicbles in both 
the learning and retention of contro- 
versial materials, verbal reasoning 


ability is functionally related only to 
learning. 


Effects of Attitudes and Attitudinal Bias 
on Learning and Retention 


It has been suggested that the facili- 
tating effect of advance organizers is 
primarily due to their interaction with 
the cognitive dimension of attitude struc- 
ture. The main thesis of this paper is 
that the cognitive dimension of attitude 
structure is the major variable in the 
learning and retention of controversial 
materials. The intent is not to mini- 
mize the obvious significance of extrin- 
sic motivational factors in a subject’s 
general approach to learning and sub- 
sequent recall of the learned materials. 
What is suggested is that the general 
interpretation often found in the 
psychological literature that intrinsic 
motivational or affective factors (e-go 
attitudinal bias) account for the phe- 
nomenon of selective forgetting in rela- 
tion to learning tasks involving only a 
moderate amount of ego threat, is un- 
tenable. In order to explore this thesis 
further in relation to the present study, 
it is first necessary (a) to determine the 
comparability of the present research 
to previous studies investigating the 
phenomenon of selective recall, and 
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——— Pro-liorthern Group 
eutral Group 
ro-Southera Group 


Tearning nites 
Test mee 
Fic. 1. Mean learning and retention scores 


for different altitude inventory levels with no 
statistical control (control group only). 


(b) to clearly distinguish between the 
effects of cognitive and affective factors 
on the learning and forgetting processes 
in order to establish their relative im- 
portance, 

Comparability of the Present Study 
to Previous Research. No hypotheses 
were ventured in this study regarding 
the effect of attitudes (as differentiated 
from attitudinal bias) on learning and 
retention, since the nature of this effect 
has been clearly shown in previous re- 
search (Edwards, 1941; Levine & Mur- 
phy, 1943; Taft, 1954; Watson & 
Hartmann, 1939), Nevertheless, an im- 
portant aspect of the present study is 
to ascertain the consistency of our gen- 
eral findings with previously demon- 


28 


PE 
& 
18 “Se. 
—— Fro-lorthern Group a 
Neutral Group 
a6 > Pro-Southern Group 
a Retention 
~ qeventio: 
net Test 
Fic. Mean learning and retention scores 
for different attitude inventory levels, cor- 


rected for DAT (control group only). 


-Northern Group 
tral Group 
ro-Southern Group 


ere Retention 
i Test 


Learning 


Fic. 3. Mean learning and retention scores 
for different attitude inventory levels, corrected 
for pretest (control group only). 


strated attitude effects. (Means of the 
attitude level groups on learning and 
retention, uncorrected for either pretest 
or DAT, are shown in Figure 1.) 

The principal attitude effect studied 
in the learning of controversial materials 
is the phenomenon of differential rates of 
forgetting for subjects with negative and 
positive attitudes, respectively. A gen- 
eral indication of the comparability of 
the findings of the present study to pre- 
vious research findings can be obtained 
by comparing the percentages of ma- 
terial forgotten by negative and positive 
attitude groups in the study reported 
herein to corresponding percentages in 
those previous studies in which both a 
test of learning and a test of retention 
were used. These percentages are given 
in Table 7, ordered in terms of the reten- 


TABLE 7 


TABLE OF DIFFERENTIAL RATES OF FORGETTING 
ED IN PERCENTAGES AND DF INDEX 
ror Fovr STUDIES 


EXPR 


Percentage forgotten 


Attitude oon 
level Taft Presenta Levine” Edwards 
Negative 42 36 29 13 
Positive 37 28 21 8 
DF index 1.14 1.29 1.38 1.63 
Time-da: 3 7 14 21 


of present study 


a Result uncorrected for independ- 
ent vari 
» Le 
materials. 


les, on sents 
He and Murphy's results for anti-Soviet-Union 
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tion period (in days) and rendered com- 
parable by a “differential forgetting 
(DF) index. This index was computed 
by dividing the percentage forgotten by 
the negative attitude group by the per- 
centage forgotten by the positive atti- 
tude group. The general consistency of 
the present research findings with previ- 
ously reported results is clearly demon- 
strated. : 
Attitude and Attitudinal Bias Varia- 
bles. As previously stated, the affective 
component of attitudes consists of the 
general complex of feelings that a par- 
ticular organization of ideas arouses in 
the subjects. This affective component 
is synonymous with attitudinal bias. 
Levels of attitudinal bias are operation- 
ally defined, in terms of our statistical 
model, as attitude inventory scores with 
the effect of pretest scores (estimate of 
the cognitive dimension of attitudes) 
held statistically constant. In contrast, 
attitude levels as such are operationally 
defined in terms of attitude inventory 
scores when pretest is uncontrolled. To 
introduce a control and reduce the error 
variance in analyzing the effects of atti- 
tude levels on learning and retention, 
DAT was used as a predictor variable. 
Effect of Attitudes on Learning and 
Retention. An analysis of covariance of 


attitude levels x retention (control 
group only) with DAT held constant, 
shows a suggestive but not signifi- 
cant attitude x retention interaction 
(F=1.11; see Table 8). This same ef- 
fect was found by Edwards (1941), 
Taft (1954), and Gustafson (1957) and 
was interpreted by these investigators 
s “repression” due to affective or mo- 
tivated forgetting. In none of these 
three studies, however, was the inter- 
action effect as pronounced as in the 
present study. Direction of interaction 
is clearly seen in the table of atti- 
tude level means corrected for DAT 
(Table 9). This trend is entirely con- 
sistent with the findings of related re- 
search. Moreover, the “differential 
forgetting” effect is more strongly sug- 
gested by the above data (with the aid 
of statistical controls) than in the work 
of Taft, Levine and Murphy, or Ed- 
wards. The DF index for the data in 
Table 9 with DAT held constant is 1.92. 
It seems, therefore, that the differential 
forgetting effect which Edwards (1941) 
interpreted as due to a “conflict with 
[the] ego’s desires” (p. 34), and Taft 
(1954) interpreted as due to “defense” 
and “repression” (p. 27), and which 
Gustafson (1957) referred to as due to 
an “affective factor in retention” (p. 49), 


TABLE 8 


ANALYSIS OF COVARIANCE * or Attirupe INVENTORY LEVEL: 
PRETEST CONSTANT 


S X RETENTION Hore 


Adjusted 
Satie di SS; SP SS SS ar EE p 

Attitude inventory 2 21 461 10057 313 2 157 2.21* 
Retention 1 2250 —1193 633 2817 sf 2817 39.7** 
Attitude inventory X 

retention 2 45 —162 738 158 2 79 TAL. 
Error 126 14193 23084 99892 8859 125 71 

Total 131 16509 22190 111320 12086 


Note.—Null hypotheses concernin; 
a Control group only. 

*p<.13. 

AP POs 


g homogeneity of variance and regression accepted. 
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TABLE 9 


Misa LEARNING AND RETENTION SCORES FOR 
IFFERENT INVENTORY LEVELS CORRECTED 


ror DAT € 
Attitude Control group M 
inventory : Learning- 
level Learning Retentjon retention 
f o diference 
Pro-Northern 26.6 14.5 12.1 
Neutral 25.8 16.8 9.0 
Pro-Southern 27.5 20.9 6.6 


Note.—N for each i 

; h subgro! 

“Control Meus Se group is 22. 
a) 


can be attributed to the attitude variable 
as defined above. It is possible in the 
present research design, however, to 
consider the relative importance of the 
Cognitive -and affective components of 
attitude in causing “selective forget- 
Ung.” Clearly, in the work cited above, 
and implicitly in most other studies of 
fhis phenomenon, the interpretation has 
Deen entirely in terms of “affect.” 
Efect of Attitudinal Bias on Learning 
ma Retention. The hypothesis that posi- 
e attitudinal bias facilitates and that 
tii attitudinal bias inhibits the 
$ arning of controversial materials was 
ejected. The differences were in the 
Pratot direction (see Table 10) but 
ere not statistically significant. 
The differential forgetting trend re- 
Poren above and shown graphically in 
igure 2, although not within an accept- 


TABLE 10 


M 
at LEARNING AND RETENTION SCORES FOR 
TEFERENT ATTITUDE LEVELS, CORRECTED 
FOR PRETEST* 


Á 
attitude Control group M TE 
lever > Learning Retention retention 
difference 
No-Northern 25.1 16.4 8.7 
Bet 2359 176 83 
‘To-Southern 27.1 19.8 73 


Note. for each subgroup is 22. 
ontrol group only. 


able range of statistical significance, is 
comparable to that found in previous 
studies involving controversial material 
in which the results were also suggestive 
but nonsignificant. The central focus of 
research interest in this area has been 
on the attitude x retention interaction. 
This interaction effect has been at least 
as clearly shown in the present study as 
it has been in previous research. 

However, when pretest is held con- 
stant in an analysis of covariance of at- 
titude inventory levels X retention (con- 
trol group only), the inventory level X 
retention interaction is reduced from 1.13 
(pretest not controlled) to .08 (pretest 
controlled; see Table 11). Comparison 
of the differences between learning and 
retention means, both before and after 
pretest is controlled, also clearly estab- 
lishes that whatever attitude X reten- 
tion interaction occurs is entirely at- 
tributable to the cognitive dimension 
of attitudes. When inventory levels 
are uncorrected for pretest, the differ- 
ence between the learning and reten- 
tion means for the pro-Northern- 
attitude group is 12.1 compared to 
6.6 for the pro-Southern-attitude group 
(see Table 9). When, however, the effect 
of pretest scores is eliminated, the cor- 
responding differences for the negative 
and positive attitude groups are 8.7 and 
7.3 (see Table 10). The elimination 
of the attitude x retention interaction 
is readily seen by comparing Figures 2 
and 3. 

The hypothesis that attitudinal bias 
has no effect on the retention of contro- 
versial materials was therefore sup- 
ported. The elimination of the attitude 
x retention interaction when the effect 
of pretest was controlled indicated that 
any selective forgetting must be attrib- 
buted to the cognitive and not to the 
affective dimension of attitude as previ- 


ously interpreted by Edwards, Taft, 


Watson and Hartmann, and others. 
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TABLE 11 


ANALYSIS OF COVARIANCE ® OF LEARNING AND RETENTION HOLDING PRETEST CONSTANT 


Adjusted 


Source dj SS; SP SS. SS; dj MS F 
; i i 2 21 119 674 155 2 78 DA. 
—— 1 2250 66 2 2162 1 216 31.3% 
7 i 5 38 38 2 6 08 
i inventory X retention 2 45 38 38 11 2 
Ara ca : 126 14193 8360 12492 8598 125 69 
Total 131 16509 8583 13206 10931 130 


Note.—Null hypothesis concerning homogeneity of 
a Control group only. 
*p< Ol. 


Through lack of adequate control of 
the cognitive dimension of attitudes 
these investigators, in our opinion, have 
mistakenly attributed differential rates 
of forgetting in positively and nega- 
tively biased groups to intrinsic moti- 
vational factors acting on the forgetting 
process. When adequate controls are 
introduced it becomes readily apparent 
that it is the lack of appropriate sub- 
suming concepts in attitude structure 
that renders “other side” arguments 
more susceptible to rapid forgetting. 
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EFFECT OF CERTAIN SETS UPON COMPLEX 
VERBAL LEARNING? 


M. C. WITTROCK 
University of California, Los Angeles 


To test the effect of,certain sets upon learning, w: 


ritten passages on 


Buddhism were given to 143 college students. Before they read the pas- 


sage 3 groups of Ss were given, 
and compare and contrast Bu 
Ss was given a set to underst: 
passage on Buddhism. 
between means. 


(p > 05, 2-tailed) from Group 4, 
different (p < .05, 2-tailed) from 
retention tests. It was concluded that learning 


ddhis 
and and to remember the content of the 


respectively, a set to compare, contrast, 


m with Christianity. A 4th group of 


The data were analyzed by 


Although Group 1 wa 
Groups 2 and 3 were significantly 


Group 4 on both the learning and 


t tests for differences 
s not significantly different 


sets are important vari- 


ables in some types of complex verbal learning. 
pe 


In complex verbal learning one im- 
portant veriable is the interaction be- 
tween the material to be learned and the 
students’ related information. For ex- 
ample, Ausubel and Fitzgerald (1961) 
found that the learning of the content 
of Buddhism was enhanced by written 
introductions which explicitly compared 
and contrasted Buddhism and Christi- 
anity. In Ausubel’s introductions certain 
Concepts were made explicit and were 
directly given to the learners. At least 
two factors, learning set and specific in- 
formation, were probably involved in 
these introductions. It is possible that 
simple learning sets, which contain no 
explicit information about the content to 
be learned, may affect the learning of 
Buddhism by actively involving the sub- 
Jects in comparing and contrasting their 
related information (Christianity to 
Buddhism). 

In this study written instructions were 
designed to eliminate explicit informa- 
tion about Buddhism but to establish 
Specific learning sets to: (4) compare 
Buddhism and Christianity, (b) com 


—- 

moe author wishes to thank the Western 
rot Processing Center and P. Twelker for 
heir important roles in the statistical analysis 


of the data. 
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trast Buddhism and Christianity, (c) 
contrast Buddhism and 
Christianity, and (d) understand and 
remember the content of Buddhism. The 
term “set” was used only in a strict 
stimulus-response (S-R) sense.? It was 
assumed that the sets produced by the 
written instructions listed under a, b, 
and c above, compared with those of d 
above, increase the probability that the 
subjects overtly or covertly rehearse 
certain pre-experimentally determined 
associations (Christianity) and that the 
occurrence of these responses facilitates 
the learning of related material (Bud- 


dhism). 


compare and 


METHOD 


Subjects 

The subjects were the 143 students enrolled 
in an upper division educational psychology 
class at the University of California, Los An- 
geles. There were 10 men and 133 women. 
All subjects were required to participate in the 
experiment. Before the experiment began, each 
subject was told that he would þe informed 
by personal letter of his own test results and 
of the results of the whole experiment, Each 


subject was so informed. 


sis of set in S-R 


2For an excellent analy: 
Goss (1961, espe- 


mediation theory terms, see 
cially pp. 264-268). 
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Materials 


The 36-item, multiple-choice Christianity 
test; the 2,500-word Buddhism es pas- 
sage; and the 45-item, ae an T ud- 
dhism learning and retention tests were i TA 
cal to the materials used and described by 
Ausubel and Fitzgerald (1961). However, be- 
tween the page of directions and the beginning 
page of the content of the Buddhism learning 
passage, a page labeled Introduction was in- 
serted. On this page two sentences conveyed 
the learning set. The sentences from the simi- 
larity treatment appear below. 


As you read this selection, try to note 
and remember the many similzrities which 
exist between the Buddhist religion and the 
religions of the Judeo-Christian tradition 
with which you are familiar. The main 
purpose of the study is to determine how 
well you can learn and remember similarities 
between the Buddhist religion and those of 
the Judeo-Christian tradition. 


The sentences for two of the other treat- 
ments differed from the above sentences only 
in that the word “similarities” was replaced 
with the word “differences,” or with the words 
“similarities and differences.” The fourth treat- 
ment contained two sentences with instructions 
only to “understand and remember” the con- 
tent of the Buddhism passage. 

A separate sheet of paper w 
cach subject. This page aske 
after each of the 9 pages of 
of following the instruction: 
tion. A scale of one (not 
(very difficult) was used. T 
to insure that the approp: 
maintained as each subje: 
passage. 


as also given to 
d him to record, 
text, the difficulty 
s in the introduc- 
difficult) to four 
he intent here was 
riate set would be 
ct read the entire 


Procedure 


Since Ausubel and Fitzgerald (1961) found 
that knowledge of Christianity and verbal 
ability were each related to performance on 
the Buddhism test, a stratified random sam- 
pling technique was used to assign the subjects 
individually to the experimental treatment 
groups. The subjects were stratified according 
to knowledge of Christianity, as measured by 
the Christianity test, and verbal ability, as 
measured by the Cooperative English Test 
(Educational Testing Service, 1950). To use a 
stratified random sampling technique was more 
defensible than a matching technique to reduce 
the error variance because the latter procedure 
would probably have introduced a sampling 


error. It would have been most difficult to 
match individually four groups on two co- 
variables without eliminating many subjects 
and without biasing the sample. 

To reduce further error variance, all four 
treatments were administered simultancously 
in the same room. Each subject worked indi- 
vidually. There was never more than a total 
of 15 subjects in the room at one time. Each 
subject was given a copy of the Buddhism 
passage which had been designed for his treat- 
ment group and a copy of the separate page 
of instructions. He was allowed 25 minutes 
to read the Buddhism passage. After he re- 
turned the passage to the experimenter, he was 
given Form A of the Buddhism test. Three 
weeks later each subject returned to take 
Form B of the Buddhism test, Both tests were 
given under untimed conditions, 


RESULTS 


The split-half reliability Coefficients 
of the Buddhism test are reported to be 
-79-.80 (Ausubel & Fitzgerald, 1961). 
The coefficient of equivalence for 
Form A and Form B was found by 
Ausubel to be .79 when the two forms 
were administered with 1 week inter- 
vening. In this study the coefficient of 
equivalence for the same two forms was 
found to be .70 with 3 weeks between 
administrations, 

Table 1 presents the means and stand- 
ard deviations for the treatment groups’ 
performance on the Christianity test, the 


learning test, and the retention test. 
Because the te 


ing the sub 
duced grou 
and stand 


ion (Garrett, 


each experi- 


mental group with the control group. 


Knowledge of Christianity was corre- 
lated .32 and .29 with the learning test 
scores and with the retention test scores, 
respectively. Verbal ability was corre- 
lated .41 and .44 with these same meas- 
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TABLE 1 


MEANS AN] 
AND STANDARD DEVIATIONS OF THE CHRISTIANITY COVARIABLE AND OF THE BUDDHISM 
LEARNING AND RETENTION DATA 


Treatment group 


Understand 


Christianity and Similarities Differences Similarities 
Buddhism > and and 
measures : Differences Remember 

E (N = 39) (N =37) (N =41) P aer] 
OSSO M SD uM SD MSD M SD 
Christianity test a 17.54 98 4 
anity 17.10 4.68 17.54 44 16.98 4.74 
Buddhism learning ‘ — 
test 21.23 © 4.89 21.57 5.32 223 
NE T eter i 1.57 32 s 22.39 5.06 19.19 5.44 
retention test 17.59 5.41 18.65 5.76 18.17 5.21 15.78 5.11 


Note.—. 
fote.—All scores were the total number of items correct out of a possible 45 for the 


tests, and a possible 36 for the Christianity test. 


ures, The ¢ ratios reported below were 
all computed by the formula cited above 
using the correlation coefficients between 
performance and Christianity, i.e., 32 
and .29, 

The assumptions of the # test were 
not violated for each of the ¢ ratios pre- 
Sented below. Histograms of frequency 
distributions for each of the groups in- 
ee in the ¢ tests were prepared by the 

M 7090 computer. After a visual 
Fema of these histograms it was 

€cided that the assumption of nor- 
ae of distribution was not violated 
ra any of the treatment groups. To test 
or homogeneity of variance, F ratios 
Were found between the most discrepant 
‘eatment group variances on the learn- 
ng test and on the retention test. These 
ratios were not statistically significant 
at the .05 level. From Table 1 it can be 
on that the standard deviations of the 
neatment groups are quite comparable 

One another. 

The ¢ between the Similarities group 
and the Understand and Remember 
Stoup was 1.80 (p > .05, two-tailed) on 
t e learning test, and 1.55 (p > .05, 
‘Wo-tailed) on the retention test. The 

between the Differences group and the 

Nderstand and Remember group was 


learning and retention 


2.02 (p < .05, two-tailed) on the learn- 
ing test, and 2.35 (p < .09, two-tailed) 
on the retention test. The ¢ between the 
Similarities and Differences group and 
the Understand and Remember group 
was 2.81 (p < .01, two-tailed) on the 
learning test, and 2.12 (p < .05, two- 
tailed) on the retention test. Thus, the 
performance of two of the three experi- 
mental groups was as predicted. The 
performance of the Similarities group 
was not as predicted. However, its per- 
formance was in the predicted direction, 
and it approached statistical significance. 
To provide a further check on the re- 
liability of the data, the three experi- 
mental groups were combined into one 
group and a ¢ test was computed between 
this combined group and the Understand 
and Remember group. The resulting ¢ 
for the learning test was 2.69 (p < 01). 
The £ for the retention test was 2.45 
(p < .05). The mean and standard de- 
viation for the combined group were 
21.73 and 5.17 for the learning test, and 
18.14 and 5.68 for the retention test. 


DISCUSSION 


Provided that they continue to operate 
throughout the learning interval, some 
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types of sets may enhance the learning of 
connected discourse material. The re- 
sults support Ausubel and Fitzgerald’s 
(1961) notion that their introductions 
contain a learning set. 

Although the absolute difference be- 
tween the experimental groups and the 
control group was only about two points, 
this gain must be weighed against the 
minimal amount of time and effort re- 
quired to establish and maintain the set. 
More research is needed to establish 
whether or not the effect obtained in 
this study is a real and a general one. 


M. C. Wittrock 
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RESPONSE MODE IN THE PROGRAMING OF 
KINETIC MOLECULAR THEORY CONCEPTS? 


M. C. WITTROCK 
University of California, Los Angeles 


ot om molecular theory program was taught to 80 elementary school 
x ildren. The experimental group learned the completion item program 
3y responding aloud. The control group listened to the same program 


without overtly responding. 


An analysis of variance evidenced an 


interaction between MA and response mode (p < .05). A 1-year reten- 

tion test evidenced a nonsignificant loss from the learning test. It was 

concluded that under certain conditions the overt response is probably 

important in determining the results of learning. , i 
s 


are Keislar and McNeil (1962a, 
Jn ) cota nti that first grade stu- 
ory _ d learn kinetic molecular the- 
Som om a 13-day, 20-minute per day 
a ei they presented the program 
n nd ividual teaching machines to pri- 
Bd school children. Two different 
nora modes were used: overt, that is, 
Dres one of three buttons to select a 
heute, choice from alternatives pre- 
to the m nonovert, that is, listening 
mode program: The overt response 
tan Was used in an operant condition- 
i el to condition to stimuli 
reliabl and meanings for concepts. No 
able difference was found between 
ine ee modes on paper-and-pencil 
tiem individual interviews which 
Sie ac retention and transfer of con- 
» but which did not involve “button 
Pushes,” 2 
ee, which involves concep- 
= aS, vocalization of concept 


1 
Je Mee author wishes to thank E. Keislar and 
in perf eil for their wholehearted cooperation 
Use of dee the study, and especially for the 
research. materials and tests from their earlier 
2 
natt recent studies, which are briefly re- 
ifferen y Krumboltz (1961), also report “no 
SPonse ces” between overt and nonovert re- 
eviden, modes, However, there is considerable 
daine ia which is reviewed in detail by Lums- 
tate dienes! that the overt response can facili- 
erent types of learning. 
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labels is a type of overt motor response 
which is probably more relevant than 
is the one used by Keislar and McNeil. 
The present study used the same type 
of subject matter and type of subjects 
used by Keislar and McNeil (1962a) 
but used vocalization as a type of overt 
response. It was hypothesized that the 
learning of meanings of words can be 
facilitated by the conditioning of ver- 
balizations of these words to the auditory 
and visual stimuli of a program designed 
to teach concepts. For discussions of the 
conditioning of word meanings, see Mow- 
rer (1960, pp. 117-162), Osgood (1953, 
pp. 680-727), and Staats (1961). 


METHOD 


Kinetic Molecular Theory Program 


The program consisted of images from col- 
ored slides made from artists’ drawings and of 
commentary played from a tape recorder. The 
program was designed to teach kinetic molecu- 
lar theory, including the definition of mole- 
cules, the movement of molecules, various 
states of matter, evaporation, and condensa- 
tion. 

For the overt response group, the program 
was written in completion item form. The 
last word of most of the sentences was to be 
supplied by the subjects during 5-second pauses 
in the commentary. The beginning of each 
pause was indicated by an audible tap of a 
bell. After the pauses, the taped commentary 
presented the correct words. The words which 
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the students were required to speak aloud were 
labels for concepts, such as “air,” “molecule, 
or “gas,” or labels for characteristics of the 
concepts. The program was written to provide 
cues in the forms of introductions and explana- 
tions to elicit the labels. 

For the control group, the slides and tapes 
were identical to the ones used for the experi- 
mental group, except that the 5-second pauses 
and the brief introduction on overtly respond- 
ing did not occur. For both groups, the pro- 
gram was written in eight consecutive parts, 
each part 15-20 minutes in length. 

After the initial writing of each part, the 
program was individually administered to first 
graders in a school different fron the one in 
which the experiment was performed. Six 
boys and six girls were chosen to represent 
varying levels of IQ and achievement. All 
student responses were recorded and used in 
refining and rewriting the sequence and con- 
tent of the frames of the program, After indi- 
vidual sessions with four students, the pro- 
gram was revised according to the feedback 
obtained. This process of presenting and re- 
vising was repeated two more times with the 
other eight students. 


Subjects 


The 80 first and second grade subjects were 
divided into two individually matched groups 
of 40 each according to mental age (MA), and 
as nearly as possible, according to chronologi- 
cal age (CA), IQ, and sex. The mean and 
standard deviation for MA of the overt group 
were 84.3 and 9.7. For the nonovert group 
these figures were 84.5 and 10.6. For IQ these 
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figures were 119.7 and 13.9 for the overt group, 
and 119.1 and 14.6 for the covert group. 

The subjects of this study were taken from 
a school district immediately adjacent to 
School A of the Keislar and McNeil (19622) 
study. The subjects from these two studies 
were comparable in IQ, MA, CA, and in socio- 
economic status. 


Procedure 


The program was presented in a room 
equipped with 10 tables partitioned from each 
other. The subjects were run in groups of 10 
or less, Each child wore a set of headphones 
through which he heard the taped commentary. 
Two microphones attached to two additional 
tape recorders operated in the room. These 
two tape recorders were controlled to operate 
only during the 5-second pauses in the tapes 
for the overt response groups. Thus, there was 
a record of the oral responses of 8 of the chil- 
dren. Experimental and control groups were 
tun in ABBA fashion to counterbalance the 
time of day. The program was completed in 
8 consecutive school days. Immediately after 
the end of the instruction period, the 10-min- 
ute individual, standardized interview and the 
written, multiple-choice group tests described 
elsewhere (Keislar & McNeil, 1962a) were 
given, 

One year later the written, multiple-choice 


group test mentioned above was given again 
to the subjects, 


REsutts 


The error rate obtained from the re- 
cordings of the responses of the overt 


TABLE 1 


Scores OF THE OVERT AND Nonoverr GROUPS ON THE WRITTEN PosTTESTS 


Posttest 
Grou z 
p Learning test 1-year retention test 
= = s9 N M SD 
Above median MA 
Overt 20 27.80 P 
i 03 1 4.86 
Nonovert 20 29.70 465 u poe pe 
Below median MA 26.0. l 
Overt 20 26.60 sa 
1 s ; 6.23 
Nonovert 20 23.85 6.13 = A 5 5.86 
Combined overt 40 27.20 5.52 36 25.45 $54 
Combined nonovert 40 26.78 6.16 36 25.10 4.95 
Note.—Possible score was 38. 


Response MODE IN ProcraMep LEARNING 


TABLE 2 


Su MMARY OF THE RANDOMIZED BLOCKS ANAL- 
YSIS OF VARIANCE FOR THE WRITTEN 
LEARNING TEST 


_ Source df MS F 
MA 248.5. 5 
Response mode i E <i 
Interaction 1 108.10 4.85* 

39 40.22 l 

37 22.28 

79 422.74 


a was 26%. An error was recorded 
vhen the subjects failed to respond or 
responded incorrectly. 
a summary of the results for the writ- 
a Posttests are presented in Table 1. 
S of variance for the groups 
F ie in Table 1 was assumed after 
(p> oe no statistical reasons 
Naa to discredit the assumptions. 
after red of distribution was assumed 
ution istograms of the frequency distri- 
exami s for the treatment groups were 
ned. 


ad 
Written Learning Test 


iene the overt and nonovert sub- 
IA had been individually matched for 
le a 2x2 factorial, randomized block 
ign (Edwards, 1960, pp. 213-215) 
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was an appropriate analysis of variance. 
The two factors were: (a) above and 
below median MA, and (b) overt and 
nonovert response modes. The blocks 
were the 40 pairs of matched subjects. 
The variance due to interaction between 
response mode and MA was statistically 
significant (p < .05). From Table 1 the 
overt response mode was more effective 
with the below median MA subjects than 
it was with the above median MA sub- 
jects. Performance was correlated .40 
with MA and .40 with IQ. 


One-Y car-Later Test 


The retention and transfer test evi- 
denced no significant interaction be- 
tween MA and response mode. The 
means for the overt and covert response 
groups showed no statistically significant 
loss in retention over the 1-year period. 


Measures of Efficiency 


The running time of the tapes was 
120.2 minutes for the nonovert group 
and 165.0 minutes for the overt group. 
By dividing the criterion measures pre- 
sented in Table 1 by the respective run- 
ning time in minutes of the taped pro- 
gram, measures of efficiency were 
obtained. The efficiency measures were 
each multiplied by 100 and are pre- 
sented in Table 3. As this table shows, 


TABLE 3 
SCY MEASURES FOR THE OVERT AND THE NoNOVERT Groups ON THE LEARNING TEST 
Subject N M SD Movert—Msonovert t 
Above median MA a 
v 
se group 20 16.85 3.08 7.86 6.96** 
Bal Overt group 20 24.71 3.87 
On median MA 
Vert group 20 16.12 3.56 372 2.20* 
Con overt group 20 19.84 5.10 2 
Mbined overt subjects 40 16.48 3.35 ee. 6.678% 
22.28 5.12 = 


Jombi 
x bined nonovert subjects 
mei 


A 
TE 


-05. 
O1 


IN 
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the nonovert group was more efficient 
(p < .01, two-tailed) than the overt 
group. 


Discussion 


The interaction between response 
mode and MA implies that relevant 
overt responses may enhance learning of 
difficult concepts by primary school chil- 
dren who are average or nearly average 
in scholastic ability (IQ below 120), but 
that relevant overt responses may add 
nothing to learning of concepts by chil- 
dren with high scholastic ability (IQ 
above 120). However, the interaction 
was not statistically significant 1 year 
later. 

After this study was completed Gold- 
beck and Campbell (1962) reported a 
related finding. They found an inter- 
action between response mode and diffi- 
culty level.* The positive results ob- 
tained in the present study and those by 
Goldbeck and Campbell (1962) do not 
agree with the studies mentioned in the 
introduction which report no differences 
between response modes. It would be 
premature to conclude on the basis of 
these latter studies that response mode 
is not an important variable in classroom 
learning. These no differences findings, 
as well as the retention test results of 
the present study, probably evidence a 
need for more sensitive measuring instru- 
ments than are presently available, and 
for continued research on mode of re- 
sponse with relevant operants. 

At face value, the retention test re- 
sults imply that programed learning 


3 The overt response groups performed be- 
low the covert response groups at the lowest 
difficulty level but above the covert response 
groups at the intermediate difficulty level, The 
subjects were seventh graders and the tasks 
were independent factual items from social 
studies. Insofar as difficulty level of scholastic 
tasks and scholastic ability are inversely re- 
lated, their results and the results of the pres- 
ent study are in agreement. 


which is designed to develop concepts 
can produce a high percentage of reten- 
tion. These scores may be high for sev- 
eral spurious reasons: (a) practice from 
the learning test, (b) intervening learn- 
ing, and (c) intellectual development by 
the subjects. The results do not indicate 
that the children knew the material 
before the experiment began. On the 
tests used in the present study, Keislar 
and McNeil (1962b, p. 107) found that 
primary school children who had not 
studied the program scored near chance 
and definitely below the scores of the 
groups who had studied the program. 

One could argue that the “1-year- 
later” scores of the present study should 
have been higher than the learning scores 
(e.g., Tyler, 1934) because further learn- 
ing and application of concepts should 
have followed during the year. How- 
ever, such findings are rare. The reten- 
tion test scores appear to be unusually 
high. 

This study supports Mogar (1960) 
and Keislar and McNeil (1962a, 1962b) 
who found that the primary school 
child’s conception of physical relation- 
ships can be enhanced by instruction- 
Not only can some primary school chil- 
dren learn, retain, and transfer the rudi- 
ments of kinetic molecular theory, but 
they can learn them very quickly. 
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STRUCTURE OF ABILITIES IN A NON-WESTERN 
CULTURE’ 


GEORGE M. GUTHRIE 


Pennsylvania State University 


A battery of 50 tests including some tests in the Philippine dialect, 
Tagalog, was administered to 314 Philippine women college students. 
22 factors were extracted. Verbal, numerical, rote memory, visualization, 
fluency, and speed factors were found to be very similar to those found 
by others. Several factors were found which appeared to be a product 
of the Philippine educational tradition. Memory and reasoning factors 
were somewhat ambiguous. The Tagalog verbal factor was quite sepa- 
rate from the English verbal factor. Some implications for further 
research using more thatching tests in the non-Western language were 


suggested. 


Our knowledge of the factorial struc- 


ture of ability is based almost exclu- 
sively on data gathered from English 
speaking subjects. The degree to which 
factors found and confirmed in one 
culture will be found also in markedly 
different cultures remains unknown. 
Klineberg (1935) has summarized the 
evidence that cultural factors make it 
virtually impossible to evaluate levels 
of ability across different cultures. For 
this reason, the conclusion of Porteus 
and Babcock (1926) that marked differ- 
ences in intelligence exist between dif- 
ferent races has been questioned. The ef- 
fect of environmental influences has been 
demonstrated within our own society 
where subtle cultural factors appear to 
be responsible for some of the differ- 
ences between means found on different 


1 These data were collected during a Ful- 
bright appointment at the Philippine Normal 
College, Manila. The author wishes to ac- 
knowledge the help of E. C. Ramirez, Presi- 
dent, and his staff. He also wishes to acknowl- 
edge the helpful advice of J. wW, French, 
S. Vandenberg, and D. R. Saunders, Finally, 
the analysis was made possible by D, Laird 
and the staff of the Computation Center of 
Pennsylvania State. A paper based on these 
results was presented at the annual American 
Psychological Association Convention, New 
York, September 1961. 
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social groups. But the organization of 
abilities is another matter, and evidence 
is needed on the degree to which facto- 
rial structure remains constant across 
widely different cultures. 

Among the factors that could produce 
differences in the factorial structure of 
abilities are the linguistic system, ge- 
netics, enviromental demands, and the 
mode of life of the subjects. Whorf 
(1956, pp. 78-83) made rather dramatic 
speculations about the manner in which 
different linguistic systems may mold a 
person’s way of thinking. In order to 
evaluate the differences he postulates, 
we would have to study subjects whose 
linguistic system is considerably re- 
moved from our own, preferably some 
system outside of Indo-European lan- 
guages. The Whorfian hypothesis, in- 
triguing as it is, has been difficult to 
reduce to verifiable implications. With 
respect to hereditary influences, Vernon 
(1951) insists that genetics may ac- 
count for 75% of the variance in the 
level of ability, but he does not consider 
evidence on the role of genetic factors 
in the structure of abilities. If hereditary 
factors influence the level, it is possible 
that they also influence the correlations 
between samples of various abilities- 
Environmental demands lead to differ- 
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ing levels of development of abilities 
but whether specific demands can lead 
to specialized factors remains uncertain. 
For instance, do members of a society 
Which leans strongly on authority and 
tradition develop reasoning abilities 
Malich are organized differently? Finally, 
ae pattern of relationships between 
people may lead to subtle skills of inter- 
E onil perception or memory. In some 
areas a different language must be used 
P eng to a superior than in speak- 
i subordinate. Does there emerge 
a a society a set of correlated per- 
Da ne related to these role shifts? 
Elem BS , we know that our tests are to 
of te ea culture bound, but we do 
zi now how general are our factors. 
m Si language differences are so ob- 
E he Saran tests have often been 
Sovia A expectation that these would 
be a equate measures which would 
The ve ively free of cultural factors. 
Gros eports of Jahoda (1956) and Scott 
A 50), however, indicate that, in going 
Te Softer culture, it is not enough 
ped to substitute nonverbal for ver- 
rat lenge We do not know what we are 
ris he: because there are few re- 
Bost of factored batteries on other than 
ee speaking subjects. 
omnes (1936, p. 195), reviewing the 
anth ation of psychological tests in 
r ropological work, concluded, 
of intent admit the existence of different types 
different ea anid of the watled gols oe 
ake them ee assign to them; we must also 
tests of ae account in Ge gable Igoe 
much be pers igence. . . . We should d a 
intelligence ung mid MeEASUENS, oe ng nd 
Qualities co as analyzing different types and 
Ej intelligence. 
opetteen years later Vernon (1954) 
erved, 
apt recognize that intelligence itself is a 
Celts SAN, BEOU: a o Wenen 
values highly symbolic reasoning 
another group’s intellect might be most 


fully 
Y extended in a very different field of 


activity say religious rituals, hunting or farm- 
ing. It would be necessary then to devise tests 
within this field, and by means of factor analy- 
sis to arrive at the structure or makeup of the 
Highest Common Factor or g in the group’s 
abilities. But if cultures were not too dis- 
similar, tests might be found which had good 
g loadings in both, 
Biesheuvel (1949), who has also had 
experience testing non-Western groups, 
after surveying factors that could influ- 
ence test scores, suggested that by means 
of factor analysis “it should be possible 
to discover not only the basic constitu- 
ents of intelligence in any given case, 
but also its cultural and genetic deter- 
minants.” This may be too much to hope 
for. He has developed his thesis with 
special reference to the study of African 
ability (Biesheuvel, 1952a, 1952b). 
Some of the questions about the gen- 
erality of primary mental abilities may 
be answered by administering batteries 
of tests in English and in some non- 
Indo-European language to bilingual 
subjects. Vandenberg (1959) has con- 
ducted such a study with Chinese stu- 
dents studying at American universities. 
He found five factors: spatial, verbal, 
number, memory, and perceptual speed 
which closely approximated those of 
Thurstone. In addition he found an 
ambiguous reasoning factor and a sepa- 
rate Chinese vocabulary test factor. He 
concluded that, 


cultural influences play a role in the process 
leading to the formation of abilities under- 
lying some of the factors, but that at least 
several potentialities exist in the adult human 
neurophysiological organization that are inde- 
pendent of one another and, to some extent. 
independent of the particular kind of cultural, 
linguistic, and educational background of the 
subjects tested. 

Since the research to be reported was 
done in the Philippines it should be 
pointed out that, in addition to the work 
of Porteus, others who have used ability 
tests in the south Pacific area include 
Carreon (1926), Dunlap (1931), and 
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Mann (1939). Each used tests in Eng- 
lish, verbal and nonverbal; the closest 
approach to factor analysis was Dun- 
lap’s use of tetrad difference equations. 
A more detailed examination of the pat- 
tern of correlations between various 
tests should answer the question whether 
we can assume the same ability dimen- 
sions in another society. 

This study is concerned with the 
structure of abilities in a non-Western 
population. The purpose is to determine 
the degree to which the prim:ry mental 
abilities found in American samples will 
also appear in subjects with a different 
genetic, cultural, and linguistic back- 
ground, 

The Philippines present an unusual 
opportunity to clarify some of the issues 
on the generality of factors and the role 
of cultural and biological determinants 
in the differentiation of abilities, The 
population is of the Malayan race, They 
speak a number of Malayo-Polynesian 
dialects in their homes. Their environ- 
mental demands have been quite differ- 
ent. Their family system and patterns 
of interpersonal relationships depart in 
many ways from those of the west, At 
the same time, for the past 50 years 
they have had English as a language of 
instruction in the schools, Here, then, 
is a bilingual population to whom can 
be administered a standard battery of 
tests which has been used in American 
studies. While the level of performance 
should not be directly compared, the 
pattern of correlations can be examined 
to determine the degree to which intel- 
lectual activities group in the same man- 
ner that they do in this country. From 
this we may infer how Primary are the 
primary mental abilities. 

Several questions influenced the se- 
lection of tests. Would the frequently 
identified abilities emerge again? Would 
the verbal factor, which accounts for so 
much variance in American studies, ap- 
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pear as prominently in the Philippines 
with its less developed education empha- 
sis? Is memory structured in the same 
way in the Philippines where, with less 
reliance on writing, memory functions 
are more emphasized? In view of the 
perplexity Americans have sometimes 
experienced with Philippine reasoning 
processes, are reasoning factors organ- 
ized there as they are in societies where 
people appear to reason in more familiar 
ways? Finally, what is the effect of 


giving a parallel test in a Philippine 
dialect? 


METHOD 
Subjects 


The subjects were women collage students 
in education in their junior year. All were 
between the ages of 19 and 22. English had 
been the language of instruction throughout 
their entire school experience. More than three- 
quarters of the group came from the provinces 
of the Tagalog speaking regions near Manila 
on the island of Luzon. None listed English, 
Spanish, or Chinese as the language spoken in 
her home. About two thirds listed Tagalog as 
her home language while the remainder listed 
other Philippine dialects, such as Ilocano, 
Bicolano, or Cebuano, all members of the 
Malayo-Polynesian language family. This 
means that all subjects were bilingual, speak- 
ing at least English and Tagalog. Many spoke 
several other Philippine dialects as well. Nearly 
all subjects appeared to revert to Tagalog oF 
another dialect outside of the classroom, ‘The 
subjects, therefore, had been raised in a Philip- 
pine language environment and had learned 
English in their school experience, They could 
take tests in either English or Tagalog. 

Of some 350 subjects who were asked to 
Participate in this study, 314 completed all 
of the tests. The tests were administered in 


groups as large as 75 in four 2-hour sessions; 


spaced over several weeks. The author and 
several Philippine Proctors were present at all 
sessions. In order to insure familiarity with the 
tasks, somewhat longer explanations and prac- 


tice sessions were given. All instructions were 
in English. 


Development of the Test Battery 


ae battery of tests which was finally 
Sele 


cted is shown in the order in which it was 


I 


` 
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het oe ig The factor on which each test 
dhe ies eo ce sn Most of the tests were 
teste wore ereneh’s: (1954) kit. Additional 
area diale eee in Tagalog, the Manila 
ideational » to measure the verbal factor and 
lected wh Ai verbal fluency. Tests were se- 
mei ia had proven to be satisfactory 
SP aa the verbal, numerical, spatial, and 
motor anes factors, There were also tests of 
deductive, of Perceptual speed; of inductive, 
rote and » and general reasoning; and of both 
tions Wer ngn memory. Memory func- 
selection of aie special attention, with the 
(1954). ests based on the work of Kelley 
Md coundsrations influenced the selection 
deal of i raens ree appears to be a good 
pine aea aaa upon memorizing in Philip- 
tests of Sa n and less on problem solving, 
both ienei functions were included with 
visual aba mtu and rote material, and with 
academic wa tory presentations. An index of 
ing Droes levement was included. Reason- 
terest, es Was another area of special in- 
Perceptual order to control the influence of 
Were tide: motor speed appropriate tests 
ously raise ed. Similarly, fuency could spuri- 
7 rase correlations if not accounted for. 


Tests 


l. Anagrame ; 
Words sage in Tagalog—Make Tagalog 
ueney. m an 11-letter Tagalog word. Word 
2. Tobliet 
about es in Tagalog—Write in Tagalog ideas 
in Tagay C? topic. The test topic is given 
3. This, Ideational fluency. 
in T agalon categories in Tagalog—List things 
leristic Og that could have a certain charac- 
r p deational fluency. 
log canes a Tagalog—List words in Taga- 
fluency E with a given set of letters. Word 
5. F, ; A 
trix ore directions—Given a 5 X 5 mä- 
Mereasin ‘ig, find which letter is indicated by 
induction» complex directions. Verbal and 
Test.) (Detroit Advanced Intelligence 


6. A 
Abn. aN; zj 
Abilities pees Verbal. (Carnegie Mental 


in Fe seg Series I—Pick out the number 
belong, Tio seven numbers which does not 
Ence Test. aoe. (Detroit Advanced Intelli- 


5 to Disarranged Sentences—Sentences of from 
Order sore are presented with the word 
Whether ambled. The subject is to indicate 

the sentence is true, false, or incom- 
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plete. Verbal and several other factors. (Car- 
negie Mental Ability Tests.) 

9. Anagrams—Make words from a 12-letter 
English word. Word fluency. (Thurstone, 
1941.) 

10. Number Series II—Select which of five 
alternative pairs of numbers will continue a 
series of numbers for which an introductory 
series of from four to seven have been pre- 
sented. Induction. (Carnegie Mental Abilities 
Test.) 

11, First and last letters in Tagalog—Words 
in Tagalog which begin and end with certain 
given letters. Word fluency, 

12. Letter series—Fill in the next letter in 
a given series. Induction. (Thurstone, 1941.) 

13. High Numbers—Draw a circle around 
each one- or two-digit number which is higher 
than the number on either the right or the 
left. Space, Perceptual speed. (Thurstone, 
1941.) 

14. Spelling—Scelect the correctly spelled al- 
ternative from five. Word fluency, verbal. 
(Detroit Advanced Intelligence Test.) 

15. Vocabulary—Sclect the word that means 
the same from four alternatives. Verbal, 
(French, 1954.) 

16. Word Squares—Fill in the missing word 
in a matrix of words from a list of words. 
Words are selected to fulfill relationship sug- 
gested in the rows and columns. Deduction. 
(French, 1954.) 

17. Same or Opposite—Draw a 
around a word which means the same as or 
the opposite of the first word in a row of 
five words. Verbal. (Thurstone, 1941.) 

18. Thing categories—Name as many things 
as possible that fall in a given category. Idea- 
tional fluency. (French, 1954.) 

19. Writing rack—Write this word as rap- 
idly as possible for a given period. Speed. 
(French, 1954.) 

20. Suffixes—Give as many words as pos- 
sible that end in a given suffix. Word fluency. 
(French, 1954.) 

21. Writing Digits—Write the Numbers 1-9 
as rapidly as possible. Speed. (French, 1954.) 

22, Mathematics Aptitude Test—Solve a 
series of arithmetic problems and select the 
right answer among five alternatives. Gen- 
eral reasoning. (French, 1954.) 

23. Division—Series of division problems 
with a one-digit divisor. Numerical. (French, 
1954.) 

24. Letter Group: 
group does not belong in four sets pr 
Induction. (French, 1954.) 


circle 


¢—Select which four-letter 
esented. 
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25. Writing ait over a series of dots. 
nch, 1954. 
are ng ee the same symbol 
under a digit as is found under that digit in a 
key at the top of the page. Memory. (Follows 
Jechsler. 
E (Se O a conclusion irom two 
A sentences by filling in a missing word. 
Deduction. (French, 1954.) Hi 

28. Addition—Add up to three two-digit 
numbers. Numerical. (French, 1954.) 

29. First Digit Cancellation—Mark out 
those instances in a row where the first digit 
of the row appears. Speed of discrimination. 
(French, 1954.) 

30. Subtraction and Multiplication—Alter- 
nate rows of subtraction and multiplication 
problems, Numerical, (French, 1954.) 

31. Verbal Classification—Categorize each of 
six words in one of two lists of four words 
each. Verbal. (Thurstone, 1938.) 

32. Identical Forms—Select one of five forms 
which is identical with the first form in the 
row. Perceptual. (Thurstone, 1938.) 

33. Paper Form Board—Mark an outlined 
figure to show exact fit of a group of solid 
black pieces. Visualization, (French, 1954.) 

34. Picture-Number Memory—Memorize the 
two-digit number that goes with each of 21 
simple pictures. Memory, (French, 1954.) 

35. Punched Holes—Mark the holes on a 
piece of paper if the hole had been punched 
with the Paper folded a number of times. 
Visualization. (French, 1954.) 

36. Figure Recognition—Pick out of a group 
of 60 pictures those 20 which were seen before. 
Memory, (Thurstone, 1938.) 

37. Tagalog-non-Tagalog—The subject in 
dicated whether or not T: 
guage spoken in her home 

38. Grade-Point Ave 
grade-point average duri: 
college. 

39, Completion—Fill_ in 
sentence with first letter o; 
Verbal. (Thurstone, 1938.) 

40. First Names—Recall 
presented last name of 20 
Memory. (French, 1954.) 

41. Word-Number Memory—Recall two-digit 
numbers paired with noun, Memory. (Thur- 
stone, 1938). 

42. Digit Span—Digits presente 
groups of three to nine, 
Memory. 

43. Manila Story Recall—A three- 
story was presented orally. Recall 


agalog was the lan- 


tage—The subject's 
ng her junior year in 


word to complete 
f the word given. 


first name when 
Persons’ names, 


€ d orally in 
immediate recall, 


Paragraph 
as many 
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ideas as possible. Meaningful memory. (Af- 
ter Kelly, 1954.) 


44. Flags—Indicate whether same face of 


flag is shown on pairs of flags. Spatial. 
(Thurstone, 1938.) . 
45. Number Code—Learn a new number 


system on base 20 instead of 10, Numerical. 
(Thurstore, 1938.) 

46. Tagalog Vocabulary—Select synonym 
for each word from four alternatives. Verbal. 
(Prepared especially for this research.) 

47. Topics—Write as many ideas as pos- 
sible about a suggested topic. Ideational flu- 
ency. (French, 1954.) 

48. First and Last Letters—Write as many 
words as possible beginning and ending with 
Prescribed letters. Word fluency. (French, 
1954.) 

49. Number-Number Memory—Recall sec- 
ond number when presented first number of # 
pair. Memory, (Thurstone, 1938.) 

50. Paragraph Recall—Fill in missing words 
in a paragraph that had been presented orally- 
Meaningful Memory, (Thurstone, 1941.) 


In the testing sessions it was found that ie 
subjects tended to give up rather quickly 3 
the items became difficult, but they always 
completed the test even though they guesse 
after the first few items, Rarely were items 
omitted. The Cubes test and the False Premises 
test, with a two-alternative format, could not 
be used because the results clustered sym- 
metrically around chance. There was little 
difficulty with subjects helping each other, but 
it was difficult to keep them from turning 
ahead to new tests before the instruction wae 
given. The subjects experienced greatest dif- 
ficulty understanding tests of spatial abilities. 
The reasons for this are not too clear, but 
others report the same difficulty with other 
subjects in this part of the world. In sum- 
mary, the subjects were cooperative, but they 
tended to answer all items, reverting to guest- 
ing rather than Sustaining effort. 


RESULTS 


Analysis of Data 


Product-moment correlations were 
computed between the scores of the tests 
and the matrix was first analyzed using 
the principal components solution wit) 
unities in the diagonal. Fourteen factors 
were extracted and rotated using Kal- 
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Sers varimax solution. The results are 
shown in Tables A-C.2 

Subsequently the data were analyzed 
Using a derived estimate of communali- 
ties in the diagonal (Saunders, 1960), 
and 22 factors extracted by the principal 
components method were rotated using 
a the varimax and ratiomax (Saun- 
ne 1962) solutions. The solutions are 
D sented in Tables D-F (see Footnote 
es ae extraction of such a large num- 
een = had the effect of dividing 
chs actors found when only 14 were 
tiba i The ratiomax solution dis- 
oe ci the variance over the factors 
rite ogi so that later factors ac- 
en z more of the variance and 
P ag y were somewhat more readily 
che The results of the ratiomax 
‘th T are presented listing all tests 
he Oadings of at least .25 on each 

or. 


Interpretation 


rs . 22 factors, 16 appear to be 
ae ga The other 6 have only 
main gh loading and, at this point, re- 
Seite a bigno: The factors are pre- 
25. sting all tests with loading above 


Fa 
es Numerical Facility Loading 
Subtraction and Multi- 
23 Plication a7 
i Division 72 
3 Addition 65 
as Number Series I 27 
Number Code 26 


we = a frequently found factor 
Popul 1S quite sharply delineated in this 
Soe ion, The simple arithmetic op- 


Ame A-F have been deposited with the 
ocumen Documentation Institute. Order 
lication $ No. 7464, from ADI Auxiliary Pub- 
rary roject, Photoduplication Service, Li- 
remitto Congress; Washington 25, D. C» 
$L25 for In advance $1.25 for microfilm or 
to: Ci r photocopies. Make checks payable 
ofe uef, Photoduplication Service, Library 
~Ongress, 


erations appear in a factor separate 
from other factors which also involve 
the manipulation of numbers. 


Factor II Verbal Comprehension Loading 
15 Vocabulary 68 
17 Same or Opposite 66 
39 Completion 43 
38 Grade-Point Average 35 
14 Spelling 28 

8 Disarranged Sentences .26 


This factor is specific to content pre- 
sented in English. The Grade-Point Av- 
erage loads higher on this factor than 
on any other factor. Even though facil- 
ity in English is lower in this group, the 
verbal factor is sharply separated from 
reasoning and fluency factors which also 
involve words. 


Factor III Associative (Rote) Memory Loading 
34 Picture-Number Memory 72 
41 Word-Number Memory 69 

39 


40 First Names 
49 Number-Number Memory _ .35 


All of the high loadings on this factor 
involve the association of material that 
does not have any particular meaningful 


relationship. 


Factor IV Visualization Loading 


33 Paper Form Board 73 
35 Punched Holes 66 
16 Word Squares .25 


The two visualization tests are fol- 
lowed by a reasoning test with a low 
loading. These two factors are often 
closely related. The differentiation of 
spatial ability and visualization which 
has been somewhat uncertain, appears 
here since the Flags test does not load 


their factor. 


Factor V A Factor Specific to Anagrams Loading 
1 Anagrams in Tagalog 68 
9 Anagrams 64 
26 


6 Analogies 


When fewer factors were extracted, 
these three tests appeared in the word 
fluency factor with high loadings. It 
would appear that this should be con- 
sidered a word fluency factor specific to 
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anagrams regardless of the language of 
the test. 


Factor VI Motor Speed Leading 
25 Writing x 63 
19 Writing LACK 60 
21 Writing Digits 36 


This is clearly a motor speed factor 
on which some of the fluency tests have 
very low loadings. 


Factor VII Tagalog-Non-Tagalog Loading 
g Tagalog-non-Tagalog 74 
46 Tagalog Vocabulary 61 
2 Topics in Tagalog . 26 
1 Anagrams in Tagalog -26 


The factor is specific to the dialect 
background of the subjects. The vocabu- 
lary test in Tagalog loads this factor 
and not the general verbal factor. It is 
relatively specific to vocabulary and 
shows only a low loading of one of the 
fluency tests in Tagalog which were 
included in the battery. 


Factor VIII Ideational Fluency Loading 
47 Topics 79 
2 Topics in Tagalog 36 
18 Thing Categories 30 
3 Thing categories in Tagalog 28 


This factor shows rather clearly that 
ideational fluency is not specific to the 


language system in which the subject is 
asked to work, 


Factor IX Inductive Reasoning 
ee eog 


Loading 
12 Letter Series 59 
16 Word Squares 50 
24 Letter Groups .29 


This factor was Separated from a 
larger factor which included the visuali- 
zation tests when the more extended 
factor extraction was carried out, In 
each of the tests the subject has to work 
out the pattern that is offered and then 
supply or select the item that completes 
or continues the pattern, 


Factor X Reasoning with Number Patterns 


R Loading 
5 Following directions ea 
2 Number Series I 56 

10 Number Series IT 


36 
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This factor is somewhat obscure. It 
appears to involve problem solving op- 
erations with a number content. 


Factor XI Spelling Loading. 
14 Spelling Jt 
39 Completion A2 
20  Sufñces 37 
9 ` Anagrams 26 


This factor appeared with the larger 
verbal factor when fewer factors were 
extracted. The four tests involve work- 
ing with the letters of a word and involve 
a minimum of meaning. It is interesting 
to note but difficult to interpret that 
this factor is separate from both the 
verbal and fluency factors. It is probably 
a function of the specific experiences ° 
this population where spelling of Eng- 
lish is strongly emphasized in schools- 


Factor XIT I „onding 
a5 Number Code 65 
6 Analogies 3 
38 Grade-Point Average 30 
43 Manila Story Recall 23 


In this population of subjects the 
Number Code test does not load highly 
the number factor as it did for Thur- 
stone (1938). However both Number 
Code and Analogies loaded ‘Thurstone’s 
unnamed Factor 11. It would appeat 
that this is a reasoning factor of some 
sort. There may be an element of unde! 
Standing the task involved since many 
Subjects had trouble with the instruc’ 
tions for the Number Code test. 


Factor XIII Word Fluency Loadin€. 
4 Suffixes in Tagalog s 
3 Thing categories in Tagalog 3 
20 Suffixes 34 


This is a rather poorly defined word 
fluency factor. The First and Last Let 
ters test in English appears in Facto" 
XIV with a number of memory tests: 
while the parallel test in Tagalog show? 
its highest loading on Factor XVII, a” 


unidentified factor with a good many 
fluency tests, 


| 


=~“ 
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Factor XIV Loading 
> s, - i 

48 First and Last Letters 59 

49 Number-Number Memory 48 

40 First Names a 

41 Word-Number Memory 25 


This factor has one fluency and three 
memory tests. It would appear to in- 
volve an ability to recall according to 
certain rules. For reasons that are not 
at all clear the First and Last Letters 
test, ordinarily thought a measure of 
word fluency, does not load fluency 
factors for this population. It may be 
an expression of their memorizing ap- 
proach to the learning of English. 


Factor XV Facility with Digits Loading 
26 Digit Symbol 69 
21 Writing Digits AT 


22 Mathematics Aptitude Test .26 


, This factor is restricted to material 
thle digits and appears to repre- 
oe some facility or confidence in han- 

Ing them. It may be a product of the 
methods used in teaching mathematics. 


Factor XVI Deductive Reasoning Loading 
A Number Series II 48 
at Verbal Classification 42 
50O Paragraph Recall Al 
27 Reasoning 29 
28 


8 Disarranged Sentences 


oom tests, insofar as they have a 

mmon element, appear to involve a de- 
ma reasoning process. There is an 
ating in each of these tests of evalu- 
Hons. He plausibility of alternative solu- 
È or getting a sense of the abstrac- 


t . 
ion involved in the problem. 


measure either Word or Ideational Flu- 
ency. It would appear that these two 
fluency factors may not be so sharply 
differentiated in this population. 


Factor XVIIT Perceptual Speed Loading 
29 First Digit Cancellation 60 
32 Identical Forms 41 


This factor has been found in many 
studies. 


Factor XIX = Loading 
44 Flags 53 
20 Suffixes 26 
27 Teeasoning .26 


With the elimination of the Cubes 
test, there was only one test in the bat- 
tery designed to measure spatial ability. 
For this reason, a good space factor can- 
not be expected. 


Factor XX Span Memory Loading 
42 Digit Span 59 
37 


40 First Names 


This factor is concerned with mem- 
ory span. Notice that Paragraph Re- 
call or meaningful memory does not 
load this factor. Other rote memory 
tests show loadings which approach .25. 


Factor XXI Loading 
36 Figure Recognition 61 
35 


50 Paragraph Recall 


Figure Recognition is the only visual 
recall test in the battery. A visual mem- 
ory factor might have appeared if more 
tests which required the recall of visually 
presented material had been included. 


Factor Xvi Loading Factor XXII Loading 
uM First and last letters in j j 22 Mathematics Aptitude Test 58 
Tagalog SR 2 Topics in Tagalog 29 

a Topics in Tagalog 31 . f ; 

18 Thing Categories 29 As it stands, no interpretation of this 

1S" High Numbers 27 factor is offered. Interpretation might 

aa have been possible if more general 


20 Suffixes 


ee Was the case in the First and Last 
in = test in English, the parallel test 
Word ee does not load highly the 
test Fluency factor. Four of the five 
Sts on this factor have been found to 


reasoning tests had been included. It 
should be noted that the Mathematics 
Aptitude Test does not load numerical 
or other reasoning factors with this 


group. 
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DISCUSSION 


There is rather clear evidence that 

certain factors have emerged in this pop- 
ulation which are clearly replications of 
earlier factors. These include numerical, 
verbal, rote memory, visualization, motor 
speed, perceptual speed, and ideational 
fluency. The cross-cultural status of rea- 
soning factors is obscure. Our Factors 
IX, X, XII, and XVI are probably rea- 
soning factors but they are not readily 
matched with results on American sub- 
jects. In order to clarify the differences 
in reasoning, if such exist, it would be 
necessary to include tests in Tagalog as 
well as English. The interesting point 
is that reasoning processes do show at 
least four factors when tests are given 
in English to these subjects who for the 
most part do not habitually think in 
English. 

The emergence of separate vocabulary 
factors in English and Tagalog parallels 
the findings of Vandenberg (1959). This 
is in contrast to the ideational fluency 
and anagrams factors which include tests 


in both languages. In view of this cen- 


tral role of the verbal factor in academic 
progress this findin, 


g may have consider- 
able implications for educational ex- 
changes, 


Factors XI and XV a 
ucts of the Phili 
tem. Spelling o 


Ppear to be prod- 
ppine educational sys- 


f English words is a 
more specific skill which can be sepa- 


rated from verbal facility. No spelling 
test was offered in Tagalog since Tagalog 
is written phonetically in western script. 
Similarly, facility with digits is differen- 
tiated from numerical ability. This is 
possibly a product of the method b: 
which mathematics was taught to these 
subjects. 

Memory tests were included because 
it has been said that Philippine educa- 
tion emphasizes memory at the expense 
of understanding. Four factors emerged: 
IT, XIV, XX, and XXI, which are in 
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whole or part memory factors. Rote 
memory appears clearly as Factor III, 
but meaningful memory tests appear on 
verbal, fluency, and reasoning factors 
and do not themselves define a factor. 
Factors XX and XXI are not very con- 
vincing instances of span or visual mem- 
ory factors. Since the Grade-Point Aver- 
age does not load any of the memory 
factors, there is little evidence in these 
results of the prevalence of memory ac- 
tivities said by some to so characterize 
Philippine education and oriental edu- 
cation generally. It may be that the . 
lower facility in English of these subjects 
inhibits their spontaneity in that lan- 
guage and so gives rise to the frequent 
observation that these students rely 
heavily on memorizing. Parallel tests 


in Tagalog would Possibly clarify some 
of these issues. 


The Word Fluency tests in English 
and Tagalog do not appear on the same 
factor. There is much less evidence for 
a common word fluency factor across 
languages than for the ideational fluency 
factor. The First and Last Letters test 
in English may be more a measure of 
memory for this group. The same test 
in Tagalog appears with the heaviest 
loading on Factor XVII, a factor which 
is difficult to interpret.’ We are led to 
conclude that word fluency as measured 
by the tests in this battery is a very 
tenuously defined factor. 

From these results we may generalize 
that the most frequently identified abil- 
ity factors can be identified in this pop- 
ulation. There are, however, verbal fac- 
tors specific to the language in which the 
test is given. Other factors emerge which 
are possibly the product of instructional 
methods. These factors, obtained on 
tests given in English, tend to be more 
Specific reflecting the fact that English 
is not the native language of the subjects 
and, with lower facility, less generali- 
zation of ability has taken place. Finally, 
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all subjects were women. There is little 
Systematic evidence whether the sex of 
subjects makes a difference in such a 
jstudy as this. However, the possibility 
remains that results with male subjects 
or both sexes would not be the same. 
wee same way that cross-culture 
light SO personality have shed much 
ea on the modifiability of personality, 
an have offered opportunities to observe 
; erent effects on development of dif- 
ab environmental influences, cross- 
culture studies of the structure of 
abilities should clarify the role of envi- 
E ce factors in the structure and 
; n ier of abilities. Bilingual popu- 
ni n arog an unusual opportunity for 
> na of investigation since they can 
ngs equivalent forms in two lan- 
fies : Reasoning and memory activi- 
Pi esent especially fruitful areas for 
hee investigation. Much remains to 
iit however, to determine how 
Binge: ent tests are in dissimilar lan- 
ences Hoy mieh: g society ipfius 
testi e subject’s definition of the 
situation itself. 
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PARENTAL ATTITUDES AND COLLEGE SUCCESS 


JOHN E. TEAHAN? 
University of Wisconsin, Milwaukee 


i ccessful academically in high school, 14 of the student 
eg ip a males and 44 females) did Poorly during their Ast 
year of college. Although no differences were found in the child rearing 
attitudes of the students themselves, compared to their daughters the 
mothers of low achieving girls had stronger attitudes relating to domina- 
tion and the use of discipline (p < .01). In the case of low male 
achievers, the disparity was primarily between father and son, fathers 
being more possessive and dominating (p < 05). It is suggested that 


insufficient development in self-sufficiency and inde 


the underachievers. . 

Shaw (1961) in discussing the ap- 
parent conflicting results of research in 
academic underachievement makes the 
point that too often the conclusions 
based upon studies of low achievers do 
not take into consideration, among other 
things, the sex of the students, the aca- 
demic level at which they are operating, 
the methods by which underachievement 
was determined (i.e., whether by aca- 
demic grades, achievement test results, 
or both), and the chronicity of the un- 
derachievement. Gough (1952, 1953), 
on the basis of his studies of successful 
high school, college, and graduate stu- 
dents, has also concluded that different 
personality characteristics might be more 
effective at different Stages of the edu- 
cational process. Thus the conclusions 
which can be drawn from any study of 
underachievement must be qualified in 
terms of many varied factors. 

In the present study an investigation 
was made into the child rearing attitudes 
of college high and low achievers and 
their parents. None of these students 
were chronic underachievers jn that all 


1 This study was supported by the Wiscon- 
sin Alumni Research Foundation. The investi- 
gator also wishes to express his appreciation 
to those members of the University of Wis- 
consin, Milwaukee, Student Counseling Center 
who aided in this research. 


pendence handicapped 


had done extremely well in high school 
and all had demonstrated high levels of 
achievement on standardized tests. In 
many respects these students fit one of 
Shaw’s (1961) definitions of “hidden 
underachievers” for, in spite of the fact 
that on the basis of past history they 
seemed to be performing far above the 
level of other students, they suddenly 
fell down in their performance whe? 
placed into a new setting (college) where 


demands differed or competition was 
greater. 


METHOD 
Subjects 


These consisted of two groups of college 
freshmen (46 females and 44 males), meS 
fathers, and their mothers. All students nen 
a history of academic excellence in high sehi 
and had graduated in the upper 20% of sae 
classes and all demonstrated high scores oe 
the College Qualification Test (CQT) upon en 
tering the university. Half of these students, 
23 females (with a mean CQT of 149.4) em 
22 males (with a mean CQT of 162.6); hae 
received at least a 3.0 grade-point average ve 
the end of their freshman year and these we! 
designated as high achievers. The other nee 
of the students, 23 females (with a mean cor 
of 147.7) and 22 males (with a mean CQT S 
161.1), who were matched to the first grount 
both on the basis of CQT scores and father 
occupational level, had received a less tha? 


2.0 grade-point average and they were desig” 
nated as low achievers, 
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Materials 


The Parental Attitude Scale (Table 1) was 
Constructed of 45 items taken from the Paren- 
tal Attitude Survey devised by Shoben (1949). 
poe items Were arranged into three subscales: 

e Possessive (P) scale, the Dominating (D) 
scale, and the Ignoring (I) scale. A parent 
Scoring high on P scale would agree with an 
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his mother’s apron strings”; a dominating par- 
ent would agree with an item like, “It is some- 
times necessary for a parent to break the 
child’s will”; while a sample ignoring item 
is, “Children should not annoy their parents 
with their unimportant problems.” The stu- 
dent, his mother and his father were asked to 
rate each item on a five-point scale from 
“strongly agree” to “strongly disagree.” State- 
ments in each scale were worded in such a way 


item such as, “In the long run it is better, 


after all, for a child to be kept fairly close to that in order for a person to receive a high 


TABLE 1 
PARENTAL ÅTTITUDE SCALE“ 
Code» Item Scores > 
31. (P) A child should feel a deep sense of obligation always 4 1 3 i 5 2 
to act in accord with the wishes of his parents. MA SD UN sA MD 
52. (P) The best child is the one who shows lots of affection 5 3 2 4 1 
for his parents. SA UN MD MA SD 
33. (Dy Children need some of the natural meanness taken out 3 1 S 2 4 
` of them, UN SD SA MD MA 
34. (1) Children who fight with their brothers and sisters are 2 5 1 3 4 À 
generally a source of great irritation and annoyance MD SA SD UN M: 
to their parents. 
33. (I) Parents should receive more blame for the misbehavior s 4 3 Jl 2 
of their children. sD MD UN SA MA 
96. (PY mbes i Jay at other 5 3 2 4 
s often much better for a child to play a 1 , 
children’s homes than to play at his own home. sA SD UN MA MD 
37. (D) Ni ; ane is will against that of his 3 5 2 4 1 
Phill bi should ever set his will agi ‘x SA MD MA SD 
38) chi ‘| irely ch from their 5 3 1 2 4 
re today expect entirely too mu 5. UN SD MD MA 
ay ja ye: everyone 5 2 3 
(P) A child should love his parents above everyone else. M A = is a 
40, PE ES za ð 
(D) Mila discipline is best. ŠD MD UN MA SA 
wi i fraid of their 3 5 2 1 4 
(D) h should never have to be afraid o fe ip a dkn mp 
42. 4 : jo 2 & 8 i 4 
) Children should learn early what they are free to do ? a P 
and not free to a so that they do not always bother MD UN SA SD M 
#8 their parents. - ‘ 4 
' © i m k me secrets from 2 5 1 3 
) A ponte be expected to keep so MA SD SA UN MD 
4 i aloy E 3 
* (dD) Parents cannot expect to have complete control over 3 an nD m UN 
ai their children. i i i 5 » 
eo) Children too often intrude upon their parents’ privacy. Ža Es SD MD MA 


Scores and code letters were not included in tl 
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TABLE 2 
J ONS OF FEMALE STUDENTS 
7 ND IGNORING SUBSCALE COMPARISONS OF 
POSSESSIVE, DOMINATING, AND Ic pasion 
T E Mean 
Subseale S “Mo Fa s mo fa 
[aa 24a 37.8 38.1 41.9 
37.4 37.8 42.4 37. 9 
A 40.7 41.3 46.5 41.9 48.4 49.5 
I 36.1 36.1 36.2 38.8 40.1 41.5 po 
7 t ratio E E p naf 
Subscale S-Mo S-Fa Mo-Fa s-mo s-fa  mo-fa S-s Mo-mo Fati | 
1 2.08". 9 08 g 4 21 
2 2.52* 1.83 1.69 2,08* 1.90 25 A : = 
5 e 2.34* 1.84 3.20** 3.88%* 51 59 2.70** ecm 
T 0. 69 63 79 1.50 A2 1.70 2.21* 2.9 


Note.—Abbreviations are: S, high achieving student; 


* p= .05. 


**>= 01. 


score he would have to agree with half of the 
items and disagree with the other half. This 
was to avoid against response set as a de- 


terminant in creating a Particularly high or 
low score. 


RESULTS 


No differences were found in the child 
rearing attitudes of high and low achiev- 
ing female students (see Table 2). How- 
ever there was a Statistically significant 
difference between the attitudes of 
mothers and their daughters in the 
low achieving group. Mothers of low 
achievers were more dominating than 
their daughters while no such disparity 
was found among high achievers, The 
fathers of both female groups were sim- 
ilar in the sense that they were signifi- 
cantly higher than their daughters on 
the D and P scales. However, there were 
qualitative differences between the 
fathers which were reflected in an item 
analysis of the scales and these will be 
reported in the Discussion section, In 
addition the fathers and mothers of high 
females were significantly lower on I 
scale than their low achiever counter- 
parts. 


s, low achieving student; Mo, mother of high achiever: 
mo, mother of low achiever; Fa, father of high achiever; and fa, father of low achiever, 


While among the females it was ae 
er’s disparate attitudes which seeme 
to separate high and low aeueo 
among the males it was primary 
father’s attitudes which appeared to s€ 
these two groups apart (see Table 3). 
Fathers of low achievers were signifi 
cantly higher than their sons on the 
and I scales while no such differences 
appeared when the high achievers an! 
their fathers were compared. Fathers fa 
high achievers were also significantly 
lower on P scale than fathers of loy 
achievers. Only in the case of hig 
achievers did a difference appear betwee? 
sons and mothers, with the latter havin? 
a significantly lower score than their 0 
spring on I scale. 


DISCUSSION 


As mentioned previously Gough 
(1952, 1953) concluded on the basis oF 
his studies that in spite of a certain oya 
lap, different personality characteristic? 
might be more effective at .differe? 
Stages of the educational process. 
found, for example, that the successiu 
student in high school was very accep 
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TABLE 3 


PossEssIvE si i 
E, DOMINATING. AND ĪGNORING SUBSCALE COMPARISONS OF MALE STUDENTS 
AND PARENTS 


Subscale = : = Mean 
S Mo Fa s mo fa 
5 40.5 40.4 38.4 38.8 40.2 43.8 
i 43.7 45.9 45.2 43.7 474 50.5 
41.5 38.0 41.2 41.3 38.7 39.9 
Subscale Se 5 t ratio, 
S-Mo S-Fa Mo-Fa s-mo s-fa  mo-fa  S-s Mo-mo Fa-fa 
s = roma _ m — 
D 50 1.21 89 59 2.05* 1.52 98 09 2,45* 
I Je -65 28 1.29 2.27* 1.02 0. 52 1.94 
2.06* By 1.47 1.34 69 60 12 37 58 


Note —Abbrevi foi is ct 
fi 0 viations are: S, high 
No, Pethe of low achiever; Fa, HeT 


a. convention, orderly, and docile. 
tion M in college a different constella- 
high raits seemed to characterize the 
seh tte with more emphasis on 
ide ufficiency , and independence of 
te ore This latter finding agrees 
am er studies of college students 
1956). 1960; Stern, Stein, & Bloom 
Seach Drews and Teahan (1957) in 
mathe the child rearing attitudes of 
dea A of junior high school students 
WETE at the mothers of igh achievers 
disci | dominating and were stricter 
ao than the mothers of low 
Gou ie This finding agrees with 
for ee S conception of the docile, con- 
Hena” successful high school student. 
aie the disparity now seen in the 
cir study between low achievers and 
lett as (especially in the case of 
iin a and fathers (especially in the 
mean} males) could be interpreted as 
Sen A that these students have not 
dace a owed to develop the self-suffi- 
tees. and independence of thought 
dln ay for college success. It might 
Darema that although some level of 
domi al demands and perhaps even 
ination is necessary, too much can 


ieving student; s, low achieving student; Mo, mother of 
f high achiever; and fa, father of low achiever. 


high achiever; 


interfere with academic success beyond 
the secondary school level. 

It is interesting to note that one of 
the most frequent complaints made by 
college students who have failed to live 
up to their previous level of academic 
success in high school regards the fact 
that no one chases after them in college 
demanding that assignments be done or 
deadlines met. One gains the impression 
that they have learned to lean too heavily 
upon external forces and when these are 
not forthcoming they are unable to pro- 
vide themselves with the necessary con- 
trols. 

The fact that there was a large dis- 
crepancy between the female students 
and their fathers on P and D scales 
would seem to indicate that all fathers 
are somewhat possessive and dominating 
in their attitudes toward their daughters. 
However, there appeared to be some 
qualitative differences when individual 
items were studied. Both parents of low 
achievers seemed to demand rather un- 
questioning obedience from their chil- 
dren and were more punitive in their 
approach to them. Thus the mothers and 
fathers of low females were significantly 
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higher than their daughters on such 
items as, “A child should always believe 
what his parents tell him” (p < OL for 
mothers, p < .04 for fathers) and “Chil- 
dren need some of the natural meanness 
taken out of them” (p < .01 for moth- 
ers, p < .05 for fathers). Although the 
fathers of high achievers felt that their 
children should not choose friends with- 
out restrictions (p < .05) and would 
limit their children to making only minor 
decisions for themselves (p < .01), 
neither these fathers nor their wives 
agreed with the more punitive attitudes 
seen in the parents of lows. The latter 
felt that harsh discipline was necessary 
more often than did the parents of 
highs and this result was also sig- 
nificant at the .02 level of confidence 
in the case of both mothers and fathers. 
The fact that in the case of low 
achieving females both mother and 
father are so high on D scale would also 
possibly indicate that the dominating 
attitude of the high achiever’s father is 
tempered in the home by more permis- 
siveness on the mother’s part with, per- 
haps, a better relationship between 
mother and daughter because of their 
similar attitudes. The low achieving 
female, on the other hand, faces domi- 
neering attitudes from both parents. In 
addition the fathers of high females were 
significantly lower on I scale than the 
fathers of lows who, unlike their daugh- 
ters, felt that, “A child should be seen 
and not heard” (p < 05) and “Chil- 
dren should learn early what they are 
free to do and not free to do So that they 
do not always bother their Parents” 
(p < .01). In contrast to this the high 
fathers agree significantly more often 
than the fathers of low achievers with 
the proposition that, “The most im- 
portant consideration in Planning the 
activities of the home should be the 
needs and interests of the child” 
(@ < .05). 
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Another interesting feature which 
emerged from the study was that while 
in the case of the females it was the dis- 
parity between mother-daughter atti- 
tudes towards domination which seemed 
related to the daughter’s academic 
achievement, in the case of the males it 
was father’s attitudes which seemed to 
play the most significant role. The one 
exception to this was that mothers of 
high males seemed to be even more child 
oriented than their sons. Low fathers, 
however, were significantly higher than 
their sons in feeling that caildren should 
make only minor decisions for them- 
selves (p < .02), that they should al- 
ways believe what their parents tell them 
($ < .04) and that they should always 
be under the complete contiol of their 
parents (p < .03). There was no such 
disparity between the high fathers and 
their sons. Low fathers believe even 
more strongly than their wives that it is 
wicked for a child to disobey it’s parents 
(p < .01) and in contrast to their sons 
and unlike the high fathers they also feel 
that parents are generally too busy t° 
answer all of a child’s questions (p < 
-04) and that children should not inter- 
rupt adult’s conversation (p < 04). 
They are also more possessive than their 
Sons in wanting to play a role in the se- 
lection of playmates (p < .04) and they 
feel more strongly than either their sons 
or the high fathers that their children 
should play at home rather than at the 
homes of other children (p < .03 in both 
cases). Thus the Picture that seems tO 
emerge in the case of the low male 
achiever is a clash between a domineer- 
ing, punitive, and overprotective father 
and his son. One might also, of course: 
speculate as to whether the disparity see 
between the attitudes of low achieving 
girls and their mothers and between low 
achieving males and their fathers has 
any bearing upon a possible lack of 
identification with these parental figures- 
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One last comment should be made on 
the fact that no differences appeared be- 
tween high and low achieving students in 
any of the three subscales. Apparently, 
When sex is held constant, they agree 
quite well among themselves in terms 
of expressed attitudes towards child 
rearing. In some respects this is surpris- 
'ng, for one might expect that those 
Students who have clashed with their 
Parents on issues regarding child rearing 
might also react with demands for 
8teater freedom or less domination in a 
woe relationship and that this 
Pe be reflected in their test results. 
en aps peer influence or the more in- 
be €ctualized standards learned in col- 
md Courses have a stronger effect on 
tins oe especially when it per- 
Wheth o children in the abstract.’ 
ae a these attitudes will hold true 

ey themselves become parents is, 
of course, another matter. 
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CORRELATION OF TEACHER PERSONALITY 
VARIABLES AND STUDENT RATINGS? 


ROBERT L. ISAACSON. WILBERT J. McKEACHIE, ann JOHN E. MILHOLLAND 
University of Michigan 


A peer group nomination procedure, a descriptive adjective inventory, 
and the IPAT 16 PF Questionnaire were administered to 2 groups 
of teaching fellows in the introductory psychology course at the Uni- 
versity of Michigan. These personality scores were related to the 
teaching fellows’ teaching effectiveness ratings made by their students 
and to the factor scores obtained from factor analyses of the separate 
items of the student rating instrument. The teacher personality variable 
most consistently correlated with good ratings by students was the neer 
group evaluation of the teaching fellows’ “general cultural attainment.” 
The relations of the personality scales to the other dimensions of student 


ratings are also presented. 

Stable correlates of teaching success 
have been hard to find. Studies of teacher 
personality characteristics related to 
successful teaching have often yielded 
conclusions which needed stringent quali- 
fications. For example, Della Piana and 
Gage (1955) found that students’ evalu- 
ations of teachers were related to the 
teachers’ scores on the Minnesota 
Teacher Attitude Inventory (MTAI) if 
the classes were oriented generally to- 
ward the affective merits of the teachers. 
The student ratings of classes in which 
the predominant orientation was not in 
this direction did not correlate with the 
teachers’ MTAI scores. These findings 
suggest an explanation for the lack of 
correlation between the MTAT teacher 
scores and student evaluations when the 
students involved were all enrolled in a 
university high school and presumably 
more oriented toward cognitive rather 
than affective teacher qualities (Gage & 
Suci, 1951). 

Gowan (1955) stated that persons 
making high scores on the K scale of the 
Minnesota Multiphasic Personality In- 
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ventory (MMPI) show a tendency t0 
enter into empathic relationships and to 
make good teachers and counselors. I? 
addition, teachers identified as well-ad- 
justed were thought to be the better 
teachers. Symonds and Dudek (1956); 
evaluating personality with the use of 
the Rorschach, reported that superior 
personal organization, good adjustment 
and reasoning, capacity to relate tO 
others, and less aggressive responses 
correlated with successful teaching. I” 
his recent book Ryans (1960) con- 
trasted traits characteristic of teach- 
ers high and low on three scales of de- 
sirable teaching characteristics, Among 
the traits distinguishing the good teacher 
were emotional stability, friendliness 
cooperativeness, agreeableness, restraint, 
and objectivity, 

Practically the only agreement among 
researchers on teacher characteristics ÍS 
that all of the traits of effective teachers 
are valued in our culture, although We 
should pause to note the suggestion that 
neurotic individuals can be effective 
given appropriate circumstances of wor! 
(see the discussion of Symonds, 1950; 
PP. 692-693). 

It may be that only certain traits from 
clusters of ones with high cultural eval- 
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uation will predict success in college in- 
oo At the time the study reported 
a is paper was undertaken, a tech- 
i of assessment of five culturally 
x ued traits was being investigated by 
‘Norman (1961). This technique uses 
et ia nominations on 20 individual 
Pi pe scales which are combined to 
ie cs Scores on five personality factors. 
ion from the work of Cattell 
fs ay and was further developed by 
ie ee, and Tupes and Christal 
the Rage The factors defined by 
idee nomination procedure are 


I. Surgency (assertive, frank, ener- 
4 getic, talkative, etc.) 

s Agreeableness (cooperative, atten- 
tive, mild-mannered, not jealous, 
etc.) 

3. Dependability (responsible, con- 
å Scientious, orderly, etc.) 

` Emotional Stability (calm, poised, 
In control of emotions, etc.) 
Culture (artistic, polished, imagi- 
Native, effectively intelligent, etc.) 


WaT all five factors describe traits 
peer mani teaching we believed that the 
tifyin inations might be useful in iden- 
lated & specific personality traits corre- 
with effective college teaching. 


wn 


PROCEDURE 


Teacher Sample 


T r 
tors wine a sample of college-level instruc- 
Zenera] mi relatively homogeneous in age, 
struction, oa teaching experience, and in- 
of the fe media, we secured the participation 
Psycholo, aching fellows in the introductory 
San. In y course at the University of Michi- 
of Young successive years two different groups 

ê ae and women who had not taught 

` niversity of Michigan before became 


n their initial ; A 
heir initial instructional experience the 


teachi 
` n; . 
g fellows led discussion sections of @ 


large 
each wicture course, In the second semester 
and hotp S tirely responsible for his own class 

lectured and led discussion sections. 


We could therefore study the personality vari- 
ables related to success under two types of 
course organization, although the second se- 
mester experience was necessarily confounded 
with experience derived from the first term. 
All of the teaching fellows in the introduc- 
tory psychology course during the 1959-60 
and the 1960-61 academic years cooperated 
in this study. The majority was advanced 
graduate students in psychology. All had suc- 
cessfully completed their first year of graduate 
study and had passed the departmental Mas- 
ter’s Degree Qualifying Examination or its 
equivalent. In each of the two teaching fellow 
groups one of the instructor-subjects was a 
woman. No teaching fellow was an instructor- 
subject both years. To avoid contamination 
of the 1960-61 group by knowledge of previous 
results, no information about 1959-60 results 
was circulated. There were 17 teaching fellows 
in the fall of 1960-61 and 16 in the spring 


of 1960-61. 


Student Subjects 


All students enrolled in the introductory 
psychology courses were asked to fill out in- 
structor rating forms. Since it was contrary to 
department policy to require students to do 
the ratings if they did not wish to, complete 
returns could not be secured. Furthermore, 
not all of the completed forms could be used 
in our analyses because some students re- 
sponded in an ambiguous fashion or failed to 
answer certain items. The ratings of the teach- 
ing fellows represent the mean of between 
35 and 40 student evaluations collected from 
all of the sections taught by a given teaching 
fellow. Usable evaluations forms varied from 
58% to 84% of the total enrollments in the 


semesters reported. 


Measures 

The peer group nomination form developed 
by Norman (1961) was administered to the 
teaching fellows in a teaching seminar they 
attended. Each teacher was asked to place a 
third of his fellow teachers at each pole of 
20 items defined by “polar description” and 
covering the five traits referred to earlier. The 
remaining third on each item were then as- 
signed to a middle group. The score for a 
teaching fellow on a trait was obtained by 
subtracting the number of negative pole nomi- 
nations he received from the number of posi- 
tive pole nominations he received on the four 
items defining a given trait. s 

A self-descriptive adjective checklist, also 
developed by Norman (1961), was also filled 
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out by the teaching fellows during a meeting 
of the seminar. This inventory consists of 
200 pairs of adjectives equated for social desir- 
ability. The respondent is required to indi- 
cate which of a pair of adjectives more closely 
describes him. The five scores obtained from 
this form correspond to the five traits cov- 
ered by the peer group nomination form. 

In addition each teaching fellow completed 
Forms A and B of the Institute for Personality 
and Ability Testing Sixteen Personality Factor 
(16 PF) Questionnaire (Cattell, Saunders, & 
Stice, 1957). , 

The students in the four semesters studied 
responded to two different evaluation forms. 
The form used in the year 1959-60 and the 
fall semester 1960-61 was a short form of 
12 questions. The form used in the spring term 
1961 consisted of 43 items which were selected 
to obtain a greater number of teacher-evalua- 
tion factors than were obtained on the shorter 
form. Factor analysis of the short form pro- 
duced a large general factor, The item loading 
highest on this factor was: 

How would you rate your instruct: 


or in gen- 
eral (all-around) teaching ability ? 


1. An outstanding and stimulating teacher 
. A very good instructor 

. A good instructor 

- An adequate but not stimulating instructor 
- A poor and inadequate instructor 


Paper personality 
S will be related 
of them on the 
items, given above, for 
d to the teaching fellow 
ve factors. 


all semesters and relate 
factor scores for the fi 


RESULTS 


The students’ responses t 
teaching effectiveness item were scored 
1-5, from most to least desirable, and 
the means for the various teaching fel- 
lows correlated with their scores on each 
of the 26 personality measures. The cor- 
relations are given in Table 1. 

The only consistently high relation- 
ship is that of Peer Group Nomination 


o the overall 


Factor 5, Culture, with the students’ 
evaluation. The relation appears in both 
groups and in all four semesters studies. 
and leads us to believe that this variable 
is important. This finding has been rep- 
licated at the Ohio State University, 
where the correlation between peer ra- 
tings of culture and student ratings of 
effectiveness was .48. 

Factor scores were obtained for each 
teaching fellow on the five factors re- 
sulting from the analysis of the student 
rating instrument used in the spring 
1961. These factors and tla items which 
loaded highly on them are presented in 
Table 2. The labels for the factors are 
somewhat arbitrary, but are intended to 
reflect what the general character of the 
item cluster is, ‘ 

The significant correlations of the per- 
sonality scores of the teaching fellows 
with the factor scores for each of the 
five factors are presented in Table 3. 


Discussion 


Since the Peer Group Nomination 
Scale provides the most stable predictor 
of the students’ rating of a teachers 
overall effectiveness, it behooves us t0 
look in detail at its “culture” factor and 
the procedures used to obtain it, The 
four subscales over which scores ave 
summed to obtain a total Culture score 


are characterized by the following polar 
descriptions: 


Artistically Artistically 
sensitive insensitive 
Intellectual 


Unreflective, narrow 
Crude, boorish 
Simple, direct 
Teaching fellows rated by their peers 
as artistically sensitive, intellectual, and 
SO on, tend to be the ones rated as ef- 


? The authors 


Polished, refined 
Imaginative 


a express their appreciation tO 
D. Wickens who administered the Peer Nomi- 


nation Form and student rating form at Ohio 
State University, 
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fective teachers by their students. How 
Should this be interpreted? 

First of all we should note that be- 
Cause this is a peer nomination procedure 
we have no information as to whether 
the teachers with superior student eval- 
uations are really more artistically sen- 
Sitive, intellectual, etc. We may con- 
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clude only that the other teaching fellows 
see them as more “cultured” than the 
less favorably rated members of the 
group. It remains for further research 
to determine whether this impression of 
greater cultural attainment is really 
based on greater cultural skills. 

The students, themselves, tend to see 


TABLE 1 


CORRELATIONS è BETWEEN PERSONALITY VARIABLES AND STUDENT RATINGS OF OVERALL 
TEACHING ABILITY 


FS 


Personality variable 


Pe i 
er Group Nominations 


1, Surgency 40 
2. Agreeableness sr 
3. Dependability s 
; Emotional Stability ae 
Dar ulture sp 
h Surgency a 
fa Agreeableness at 
3. Dependability abd 
P Emotional Stability ot 
rms Culture ah 

attell factors 
y Warmth ay 
S Brightness (g) = 
s Mature, calm a 
5 Aggressiveness i 
2 nthusiasm PA 
3 Conscientiousness moa 
e dventurous so 
a Sensitivity 2 
if Jealous, suspecting o 
ti ohemian a 
A Sophisticated =l 
A Anxious; insecure o5 
a oaa eating critical 3 
ae elf-sufficient a 
te Controlled, precise =A 
~ Tense, excitable sA 
16 


N 


a Posi 7 
Ositi . . A 
a 1, sitive correlations desinate high scores on person: 
wa P < O5. 


$o. 


ality variables, as named, £! 


Semester 
1959-60 1960-61 
—— a amare iain 
Spring Fall Spring 
41 .58* 66** 
66** 52* — 01 
36 —.06 sea 
47 58* 75 
65** 67** 48 
23 46 ait 
=the 01 — 03 
= — 35 > 
07 53* =a 
13 25 28 
36 36 1 
— 03 —.04 =H 
— 05 — 48% =30 
50* wy 45 
56* 43 51* 
—.56* —05 —.28 
46 23 Oh 
50* 02 18 
103 —.19 =a 
43 —.01 47 
— 34 — 35 a 
05 08 20 
47 14 AA 
—.08 — 42 02 
— 29 03 — 44 
=f 31 24 
16 17 16 


oing with good student ratings. 
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TABLE 2 


TAINED FROM THE STUDENT Ev v ‘G OF 1961 AND THE 
Five Factors OBTAINED £ THE ST N VALUATIONS IN THE SPRING OF 1961 A 
IV A ‘AINE E 


Irem Warcas Loapep Hicuty on THEM 


Factor and Item 


I. Skill 


Put materials across in interesting way 
All-around teaching ability 

Stimulated intellectual curiosity 

Explained things clearly and concisely 
Skillful in observing student reactions 
Changed approach to meet new situations 
Tried to increase interest of class in subject 
Class time well spent 

Made clear how each topic fit into course 
Overall value of course 

Explained why he did things 

Anticipated difficulties bef, 
Improved ability to understand deviant individuals 
Improved ability to deal with personal problems 
Was aware when students failed to keep up 
Explained reasons for his criticism 

High degree of cultural attainment 


ore they arose 


TI. Overload 


III. Structure 


IV. Student Rapport 


V. 


Assigned a great amount of reading 
Assigned difficult reading 


Asked for more than students could get done 


Planned class activities in detail 
Had everything going on schedule 
Followed an outline closely 


Decided in detail what and how things should be done 


Invited criticisms of his acts 
Told students when they 
Complimented students in front of others 

Able to get personal help in course 

Improved ability to deal with personal problems 
Criticized poor work 

Was sensitive to studen 
Anticipated difficulties 
Permissive and flexible 


had done a good job 


ts’ desire to ask questions 
before they arose 


Group Interaction 


Students argued with each other and instructor without 
hostility 

Students frequently voluntee: 

Students felt free to express 

Students were friendly 


Instructor was aware when students failed to keep up 


red own opinions 
own opinions 


Loading 
Men Women 
students students 
863 847 
818 859 
755 812 
.782 .706 
568 645 
689 674 
640 487 
626 674 
561 Am 
341 589 
556 442 
572 550 
534 423 
485 528 
281 348 
560 463 
574 568 
-704 666 
679 699 
537 675 
585 727 
613 698 
645 680 
417 598 
463 .250 
428 366 
424 490 
315 199 
184 322 
— .006 225 
—.010 —.016 
.283 ani 
075 108 
383 486 
302 494 
556 .280 
384 189 
425 012 
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teachers they judge to be effective as 
ont high cultural attainment. An 
son A ing the students to rate the ex- 
kink A binge the instructor exhibited a 
mot — of cultural attainment cor- 
Ean 48 with the criterion item of 
oes 3 teaching effectiveness. Items 
aie student rating form asking for 
ae of the teachers’ talkativeness 
fe, approximately 36 with the 
= a ana effectiveness item, and 
ie asking for evaluation of the in- 

ors’ permissiveness and flexibility 
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correlated only .24 with the same crite- 
rion item. 

The fact that this appearance of 
general cultural knowledgeability should 
relate to the student ratings is not with- 
out precedent. For example, Cosgrove 
(1959) found students’ opinions of the 
extent to which instructors were “well- 
and informed about material in 
related fields to load on a factor best 
labeled as an index of mastery and or- 
ganized of course content. Beardslee and 
O'Dowd (1961) also found the student 


read” 


TABLE 3 


Cc S š 
ORRELATIONS BETWEEN PERSONALITY VARIABLES 
STUDENT RATINGS 


anp Factor SCORES OBTAINED FROM 


Men's student rating factors and 


personality variable A 


L Skil 
4 1—Surgency 69 
5E 4—Emotional Stability 77 
G 5 Culture 58 
ae 1—Surgency 54 
we 1—Dependability —.50 
PF (F) Enthusiastic, talka- 
tive 53 
16 PF (Qı)—Experimenting. 
critical, radical .50 
IL, Oy 
g erload: Ni i 
Ilr, Sthiicture o correlates 
16 PF = > — 48 
IV. Student Rapport ý 
re 1—Surgency 53 
mu 3—Dependability —.50 
PF (Qı)—Experimenting. 
VG critical, radical 72 
roup Interaction 
1—Surgency 35 
G s—Culture 49 
aes a 


Note. 
Abbreviaty 
eviations: PG, Pee Group Nominati 


Only those ci i i the .05 level of 
se correlr tions which exceed t eal, evsscriptive Adjective 


Women’s student rating factors and 
personality variable 


r 


T. Skill 
PG 1—Surgency 55 
PG 4—Emotional Stability 66 
PG 5—Culture AT 
DAI 1—Surgency 46 
DAI 4—Emotional Stability — 60 
16 PF (E)—Dominant, aggres- 
sive 49 
16 PF (F)—Enthusiastic, talka- 
tive 57 
16 PF (N)—Sophisticated, pol- 
ished — 56 
II. Overload: No correlates 
III, Structure 
16 PF (Qs)—Lax, unsure —.50 
IV. Student Rapport 
PG 1—Surgency 48 
PG 4—Emotional Stability 54 
PG 5s—Culture 2 
vV. Group Interaction 
PG 1—Surgency 74 
PG 4—Emotional Stability 46 
pG 5—Culture 65 
DAI 4—Emotional Stability — 53 
DAI 5—Culture 49 
16 PF (C)—Mature, calm — 62 
16 PF (M)—Bohemian, uncon- 
cerned 50 
16 PF (Q:)—Tense, excitable 50 
confidence are reported. 6 PF Cattell factors. 


Inventory; 1 
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image of college professors emphasized 
their all-around intellectual competence 
and sensitivity to artistic and esthetic 
experience. College professors who 
overtly manifest these characteristics 
were perceived by students as closer to 
the ideal than those who do not. 

There may be some question, however, 
whether this salience of a general cul- 
ture factor will generalize to success in 
teaching in areas other than psychology. 
The work of Riley, Ryan, and Lifshitz 
(1950) indicates that there may be some 
differences among what students think 
are most important for instructors in the 
arts, the sciences, and the social sciences, 

In our study the patterns of correla- 
tion for the other variables with the 
effectiveness item were inconsistent. In 
three out of the four semesters, however, 
the Peer Group Nomination variables 
Agreeableness, and Emotional Stability, 
and the 16 PF Enthusiasm score cor- 
related well with the student evaluations. 
We have no hesitancy in saying that a 
college teacher’s possession of agreeable- 
ness, emotional stability, and enthusi- 
asm, as well as high cultural attainment, 
augurs well for him. The preceding 
statement seems in fact to be more a 
validation of our measures than a dis- 
covery of the attributes of a successful 
teacher. 

Some of the variables that failed to 
make the grade excite our interest. Do 
students care whether a teacher is de- 
pendable? Would they just as soon 
have “cold” teachers as “warm” ones? 
In another study McKeachie (1961) 
found warmth, as rated by students and 
observers, to relate to achievement dif- 
ferently for men and women and for 
students high and low in need affiliation. 
If warmth affects some students posi- 
tively and others negatively, the effect 
may cancel out in a simple correlational 
study of the sort reported here. Other 
variables may interact in similar ways. 
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The Descriptive Adjective Inventory 
(DAI) scores yielded only two signifi- 
cant correlations with the overall effec- 
tiveness item. The tendency for the 
Emotional Stability scores in 1960-61 
to be negatively correlated may be of 
some moment. Since the correlations for 
this score evaluated via Peer Group 
Nominations are positive it may mean 
that in this group of teachers the ones 
who were regarded by their peers as 
most stable were disposed to regard 
themselves as unstable, and vice versa. 
If this sort of lack of correspondence 15 
characteristic it may undermine the 
utility of the self-report instrument. 
Norman’s (1962) results, however, may 
be interpreted more optimistically, since 
he found a correlation of .40 Letween the 
Emotional Stability scores in the tw0 
instruments, ' 

When personality variables are con- 
sidered in relation to the student rating 
factors, the same pattern described 
above for the students’ responses to the 
overall effectiveness item is found for 
Factor I for both sexes. There are, how- 
ever, some different personality corre- 
lates of the Skill factor for men and 
for women (see Table 3) 7 

No significant personality correlates 
were found for Factor IT (Overload). 
The factor analysis of the student rating 
form did, however, separate this over- 
load factor, which deals with assign- 
ments, from one which describes a” 
authoritarian class structure, Factor IIT. 
The Cattell personality dimension (Qs) 
correlates with this student rating fac- 
tor in such a way that the person who 
describes himself as lax and unsure of 
himself is the one who is compulsive 17 
classroom structure. 

Several personality variables correlate 
with the student rating factor called 
Student Rapport, but only one, Sur- 
gency, appears fur students of both 
Sexes. The peer grou “surgency” dimen 


TEACHER PERSONALITY 


sion reflects the talkative and enthusias- 
tic individual who seems to be perceived 
aS being able to get along well with the 
i ent It appears as a correlate of the 
udent rating factor Group Interaction 
also, along with Culture. 
E ene the relations we found be- 
ana i e teacher personality ‘variables 
tabik e student rating factors as es- 
ee Š only tentatively, but in the 
ane oe ey seem reasonable. We have 
ability empier as yet to argue the desir- 
A of high standing on any of the 
vo aat we would be inclined to 
tee l, Student Rapport, and Group 
ial nee ae Under these circumstances, 
Farsta igh on Surgency, Culture, and 
Saera nal Stability (as judged by their 
Shak Aa by themselves) stand out as 
thet t ely to be seen in a good light by 
students. 
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ACADEMIC PERFORMANCE OF PUBLIC AND 
PRIVATE SCHOOL STUDENTS 


JOHN A. FINGER AND 


Brown University 


Public school students are reported 


private school students. Equating on scholastic 
leave a difference favoring the public school 


Values Inventory, 


Psychological Examination; and the 


means did not differ significantly. Regress 
distributes grades aniong private and pu 


sample showed similar results for t 


that private school students do less we 


lower in scholastic aptitude and in 


Many data substantiate the conclu- 
sion that public school students receive 
higher grades in college than do private 
school students (Lathrop & Kieffer, 
1959; McArthur, 1954; Seltzer, 1948; 
Shuey, 1956, 1958). Various hypotheses 
have been advanced to account for this 
difference, 

One hypothesis is that public school 
students do better in college because they 
are more rigorously selected for admis- 
sion. This hypothesis can be dealt with 
In two parts, for selective factors may 
be based on either scholastic aptitude— 
that is, intellectual factors—or on mo- 
tivational, or nonintellectual, factors. 
Equating groups for differences in apti- 
tude has become a standard practice in 
educational research, Similar equating 
of groups for motivational differences 
has not yet become common because of 
lack of adequate test instruments, 

It will be shown that when public and 
private school students are equated for 
both academic aptitude and academic 
motivation, most, if not all, of the differ- 
ences between the two groups are ac- 
counted for. 

The data will be shown to be consist- 
ent with the affirmative hypothesis that 


1 


GEORGE E. SCHLESSER 

Colgate University 
to obtain higher college grades than 
aptitude is reported to 
student. The Personal 


a test measuring nonintellectual factors in school suc- 
cess, was administered to an entering college class. 
public school and 97 private school. 

the Scholastic Aptitude Test, Verbal a 


216 had attended 
When grades were regressed for 
nd Mathematical; the Ohio State 
rsonal Values Inventory, the group 
ing for these factors randomly 
blic school students. A second 
roup means. The conclusion is 
Il because as a group they are 
motivation. 


Pe 


he gi 


differences in performance between pub- 
lic and private school students when 
found are due to selection procedures. 

The procedures utilized in this pape 
have broader implications than the 
equating of public and private school 
Students. Differences between many 
other groups may disappear when both 
intellectual and nonintellectual factors 
are held constant. Accounting for mo- 
tivational differences will enable hypoth- 
eses to be more definite in scope, for hy- 
potheses can be confined to those con- 
cerning factors related to: (a) aptitude 
differences between groups, (b) moti- 
vational differences between groups, (c) 
neither aptitude nor motivational diffe” 
ences between groups. 


PROCEDURE 


_A test of academic motivation, the Persona! 
Values Inventory 1 (PVI; Schlesser & Finge’ 
SS 


*A copy of the Personal Values Inventor’ 
has been deposited with the American Docu- 
mentation Institute. Order Document No. 7463 
from ADI Auxiliary Publications Project, Pho- 
toduplication Service, Library of Congres+ 

5, D. D, remitting in advance 
$1.25 for microfilm or $1.25 for photocople* 
Make checks Payable to: Chief, Photoduplica- 
tion Service, Library ¢f Congress. 
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PUBIC AND PRIVATE SCHOOL STUDENTS 


Fane has been devised at Colgate University. 
rei on this test are available on large popu- 
= Te of college students who have served 
ee Wenn groups. The Inventory con- 
‘tas oe designed to measure student atti- 
tens uyara school work and peer group ac- 
we t was constructed by selecting items 
(GPA) pate with grade-point average 
insite Z ut which do not correlate with scho- 
an eee The correlation of the PVI 
a mie college grades for this sample is 
Verbal fees the Scholastic Aptitude Test, 
PVI with T-V) is 09. The correlation of 
AR maas with SAT-V held constant 
of N aan correlations are representative 
iig ah tained ina sample testing of enter- 
Š men in approximately 30 colleges. 
ample items are: 


1. My fa 
othe My friends often tried to discourage 
rs from working hard. 
2. P 
Be Fae most of my friends have seemed to 
ebellion against our parents. 
3, r 
iey ae times have you felt rather comfortably 


4. 
min Sa you have more difficulty keeping your 
your work than others seem to have? 


F 
tional ane research purposes where motiva- 
ifferences should be controlled the high 
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school record which is a correlate of both 
aptitude and motivation can be used as a sub- 
stitute for a test of motivation. In the con- 
text of the problem here such a procedure 
is obviously not possible. 

The subjects in this study were the 313 
Colgate University students, of whom 216 had 
attended public schools and 97 private schools. 
They are described in Table 1 which shows 
the number receiving various GPAs in the 
first semester over the past 3 years. As will 
be noted, public school students consistently 
earn higher grades. 

Table 2 shows the test scores and perform- 
ance levels of public and private school stu- 
dents on PV3; the College Entrance Exami- 
nation Board, SAT-V and SAT-M; and the 
Ohio State Psychological Examination (OSPE); 


and GPA for the student’s first semester in 
college. Included in Table 2 are five F ratios. 
the differences between 


In all five instances 
public and private school students are shown 
to be significant at the 1% level. On the basis 
of Table 2 it can be concluded that the groups 
differ on the three separate measures of scho- 
lastic aptitude, on academic motivation as 
measured by PVI, and on GPA. 

The reason for the difference in performance 
is hypothesized to be attributable to differences 
in scholastic ability and differences in academic 


TABLE 1 


P > 
UBLIC AND PRIVATE SCHOOL ST 


upENTS RECEIVING VARIO 
AT COLGATE UNIVERSITY 


us First SEMESTER GPAs 


Number of students by entrance year 


First sem 
ester Type of 
= __ GPA school 1959 1960 x 1961 i 7 Total ; Total % 
VA De higiter Publie 30 39 28 04 144 
2.8-3 Private 1 “l 
i Public 38 29 38 105 i 
2.4-2.7 Private 9 14 13 & es 
Public 45 54 42 j 
i 8 21 9 48 19.3 
Total c Private 1 
tal % high Public $2. 
Private ; 
ae 26.5 
‘ Public 37 65 51 173 26 
L4 Private 27 31 23 81 i 
one i 22 38 95 14.6 
Public 35 
21.8 
Una Private 18 14 22 54 d 
nae i 6 18 20 44 67 
Public 4 aa 
Tot: Private 0 6 14 sas 
al % low Public ae 
Private 


No 
te.—Four-point scale. 
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TEST SCORES AND PERFORMANCE LEVELS oF PUBLIC AND 


Josx A. Fincer anp Grorce E. SCHLESSER 


TABLE 2 


FRESHMAN CLASS ENTERING IN 1961 


Mean score 


Entrance 


PRIVATE SCHOOL STUDENTS ror, 


f College Grade first 
E N examinations examinations semester 
sc J S o E 
SAT-V SAT-M OSPE a PVI GPA 
eo o m o a ers 2.29 
i 216 572 592 9.77 36.4 Z: 
ra 97 547 564 8.02 32.5 1.98 
a ratio 8.82* 11.11* 8.02* 10.24* 14.44 i 
a Scaled score. : 
*p<.0l. 


motivation, as measured by PVI. Ií this hy- 
pothesis is correct, then equating the two 
groups for these factors should result in an 
equalizing of GPAs. 


RESULTS 


Table 3 shows the results of three 
analyses of covariance, The actual 
GPAs are shown with the F ratio from 
Table 2, so that the successive adjust- 
ments and the resulting F ratios may be 
compared. The two groups are first com- 
pared on GPA with OSPE statistically 
held constant. The resulting adjusted 
GPAs are the best estimate of GPAs if 
there were no differences between the 
two groups in intellectual factors, as 
measured by this test, The GPAs are 
then estimated for 
PVI held constant. 


groups were equated for both intellectual 
and nonintellectual factors, 

While initially GPA for public school 
students was 2.29 and for private school 
students 1.98 with an F ratio of 14.44, 
after adjustment for both OSPE and 
PVI, GPA for public school Students was 
2.23 and for private school students 
2.10 with an F ratio of 4.00. 

These data suggest that the academic 
performance of the two groups as meas- 


ured by GPA becomes more alike as the 
groups are equated on aptitude factors, 
motivational factors, and on both. 
Finally an analysis of covariance has 
been computed for GPA adjusted for all 
four of the variables shown on Table £. 
The assumption seems justified that the 
three measures of aptitude combined 
would give a better estimate of intel- 
lectual factors than a single measure. 
When this adjustment is made GPAS 
have changed only slightly from the 
previous test with OSPE and PVI, 
even though the F test is no longer in 
the area of decision, These data are con- 


TABLE 3 


ANALYSES oF COVARIANCE 


Type of A 
GPA school dj bn 
Before Adjustment E = 4% 
-98 Private 14.4 
229 Public 1/311 
Adjusted for 
kis (OSPE) > 
04 Private 8.12" 
226 Publie 1/310 
Adjusted for 
academic motivation 
(PVI) we 
2.05 Private 7.57* 
v 205 Public 1/310 
Adjusted for aptitude 
(OSPE) and academic 
motivation (PVI) o° 
2.10 Private 4.0 
2:23 Public 1/309 


s 
EKE GPAs Toi public andiprivita school sident 
regressed for OSPE, for PVI, and for both. 
a OL> p< os. 

"P< .01. 


PUBLIC AND PRIVATE SCHOOL STUDENTS 


TABLE 4 


ANALYSIS OF COVARIANCE 


Adjusted 


___ GPA dj F 
Private = 2.22 1/307 — ATE iad 


Public = 2.11 


ublic and private school students essed 
SATY, SAT-M, and PVE as 


, Note.—p 
for OSPE 
> , 
>> 0. 


eae with the hypothesis that when the 
nie equated for aptitude and 
White “se they will not differ on GPA. 
ie na cannot conclude that there 
groups a no differences between the 
matched e groups appear to be nearly 
test of th on performance. A further 
predictis e:data can be made by making 
asel u ns for each individual student 

sine oh his four test scores. Table 
are predi a number of students who 

A an ed to achieve at the given 
ment for ag with the actual achieve- 
eee, URE 1961 group.? Using chi 


°R 

tiitous or the GPA is skewed and discon- 
dicted OPA cane points, comparing the pre- 
itogina fee ee GRA: i$ difficult. The 
dicteq Gra ree was to calculate the pre- 
Scores wer for each student. These predicted 
Students e rank ordered. Since a total of 28 

25 public and 3 private) were in 


TABLE 5 


COMPARISON OF THE ACTUAL AND PREDICTED 
GPAs oF PUBLIC AND PRIVATE SCHOOL 
STUDENTS 


Number of students 


First Public Private 

semester Pre- Pre- 

GPA dicted Actual dicted Actual 
3.2 or higher 25 25 3 3 
2.8-3.19 37 35 8 10 
2.40-2.79 33 37 12 8 
2.00-2.39 48 41 25 32 
1.60-1.99 41 42 18 7 
Under 1.60 32 36 31 27 


Note.—GPA predicted from three aptitude measures 
and from a motivational measure (PVI). 


ted scores as the 
the no-difference 
ted 


square and the predic 
population parameter, 
hypothesis again cannot be rejec 
(p > 05). 

An additional way to determine the 
adequacy of the procedure is to utilize 
the equations from the multiple adjust- 


of 3.2 or higher GPA, the 28 


the highest predicted grade aver- 
mine how many were 


the category 


students with 
counted to deter 


age were 
public school students and how many were 
This procedure was 


private school students. 
f the GPA categories. 


continued for all o. 


TABLE 6 


TEs 

"ST Sco; 
RE 
ES AND PERFORMANCE LEVELS WIT 


BY PUBLIC AN 


H ADJUSTED GPAs FOR TH 
p PRIVATE SCHOOL 


E 1960 ENTERING CLASS 


Tee of — 
Schoo] . 
N Entrance examinations 

es — SAT-V SAT-M 
Ublic ee 
rivate 259 553 586 

z egression 104 547 572 

oeffes 
tits 00149 -00023 


b Scaled score 


Roa lUsted fi P i 
est estimate aptee aptitude measures and for academi 
of standard error of diference of means 


Mean scores 


Grades first semester 


College examinations 
a Adjusted 
OSPE ° PVI GPA GPA? 
10.49 37.66 2.32 2.29 
10.06 35.24 2.19 2.26 
03597 02236 
c motivation (PV1). 
for adjusted GPA = .065 
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ment used in Table 4 on an independent 
sample. 

Table 6 shows the means for the 
class which entered 1 year prior to the 
class on which the analysis has been 
made. The regression coefficients for 
the 1961 sample were used to compute 
the adjusted means for GPA for the two 
groups. The accuracy of the adjustment 
suggests that there is some stability to 
the relationships found. 
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STUDY OF RETENTION 


OF SOME TOPICS OF 


ELEMENTARY NONMETRIC GEOMETRY? 


American ROBERT M. GAGNÉ 
merican Institute for Research, Pittsburgh 


Retention was measured of the task “specifying scts, 
ang separations of sets, using points, lines 
subordinate knowledges contributing to the 


groups each of 16 6th-grade students after an inter 
] learning represented 


mental treatments during origina 


examples and in time following practice o' 
significantly lower retention for the group 
differences. In ad 
d 9-week retention in the 


in task examples, but no other 
ares shown between immediate an 
retention of subordinate knowledges. 


AND 


OTTO C. BASSLER 
University of Maryland 


intersections of sets, 
, and curves,” as well as of 
learning of this task, in 5 
val of 9 weeks. Experi- 
variations in task 
f examples. The results show 
having the smallest variety 
dition, marked changes 
patterns of 


SS 


Pe ei studies of the learning of 
brief eee knowledge have employed 
vestigat ‘instructional programs to in- 
kt a some of the variables affecting 
diffe ah measured a day or two 
eee nie completion of learning 
1962. is Tayor, Garstens, & Paradise, 
these P apne & Paradise, 1961). In 
quence udies, the factor of topic s€- 
which oe prominently as one 
the Sean considerable control over 
it has oe of learning. In simple terms, 
that the een verified in these studies 
tàin Pa e of performing Cer- 
knowled ifiable units of subordinate 
aii creates a high probability of 
whereas the new item of knowledge; 
orming e lack of capability of per- 
dinate Aes one of these same subor- 
a very a reduces this probability to 

Tha iret value (cf. Gagné, 1962). 
Present on y carried out just prior to the 
instruction (Gagné & Staff, 1963), self- 

A ieia techniques were again used 
effects af e for the investigation of the 
earning still other variables on the 
=S process, 18018 materials on non- 


1T . 

the aed is one of a series conducted by 
ect, ang rsity of Maryland Mathematics Proj- 
a Poi a a to by the staff of 
Helen o including J. R. Mayor, Director. 
+ Cole ne ee Associate Director, Mildred 
- adaigi.©! Elise B. Cussler, and W. B. Moody, in 

n to the authors. 
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metric geometry. The instruction was 
concerned with defining and specifying 
tersections of sets, and separa- 
using points, lines, and 
dy, the variables ex- 
ty of examples 
of each subor- 


sets, in 
tions of sets, 
curves. In this stu 
plored were (a) varie 
used in the repetition 
dinate task, and (b) the amount of 
time elapsing between the attainment 
of one entity of knowledge and the next. 
The subjects in this study were 90 sixth- 
grade students, randomly assigned to 
five experimental groups. Following the 
learning, a test of achievement was 
administered to all students. 

Although the results of this previous 
study again confirmed the importance of 
the variable of topic order, no signifi- 
cant differences were found to be as- 
sociated with the other variables of task 
variety and time elapsing after task 
practice. A number of reasons may be 
adduced to account for the lack of effect 
of these variables. Particularly, it can- 
not be said with confidence that any 
possible effects had sufficient chance to 
reveal themselves, in view of the fact 
that the average score on 
was 18 (out of a possible 31), 
disappointingly low. 

Despite these findi 
sidered worthwhile to 


study by measuring retentio 


ngs, it was con- 
extend the initial 
n of knowl- 
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edge in these same students several 
weeks later. For one thing, the reten- 
tion of knowledge following learning by 
self-instructional means has not often 
been measured (cf. Stolurow, 1961). 
Second, it was believed possible that 
effects of the experimental variables 
might reveal themselves in retention in 
a more pronounced fashion than in an 
immediate postlearning test. Third, 
there was an interest in discovering not 
only what happened to the criterion 
achievement following a forgetting inter- 
val, but also what happened to the sub- 
ordinate knowledges (learning sets) 
which have been found to contribute to 
this achievement during learning. 
Accordingly, an additional study was 
performed, as reported here, to measure 
the retention of the initially learned 
knowledge of nonmetric geometry after 
a 9-week interval. Measures were taken 
of (a) achievement on items matched 
in content with the original achievement 
test, and of (b) the performance of each 


of the subordinate knowledges contrib- 
uting to the final task, 


METHOD 
Learning Materials 


Details of the construction of the original 
learning materials are given in a previous paper 
(Gagné & Staff, 1963). Figure 1 indicates the 
topics of this material, together with their 
hypothesized supporting relationships. These 
topics were introduced in an order which took 
advantage of the occurrence of positive transfer 
to each item of knowledge represented from 
each subordinate item connected to it by an 
arrow. 


Experimental Treatments during 
Learning 


Five different forms of learning programs 
were used during the initial learning, which 
occupied periods of 11 successive class days, 
Program El had minimal variety in its problem 
examples; Program E2 an intermediate vari- 
ety; and Program E3 maximal variety. Pro- 
gram EO contained no problem examples 
(except for an initial one required in the com- 


pletion of each subordinate task). Program 


EA was the same in content as EO, but had 
sets of arithmetic problems inserted so as to 
occupy about the same amount of time as the 
example problems. 


Subjects 


The subjects in the study were the sixth 
graders used in the previous study. Random 
assignment of students to each experimental 
treatment was made within each of the four 
participating classes. Because of absences, data 
from two subjects (in cach of two different 
groups) could not be obtained. Accordingly, 
the data from two subjects, randomly chosen, 
were dropped from cach of the other three 
groups. This provided a total N’ of 80, with 16 
subjects in each group, on which both original 
measures and retention measures were availa- 
ble. All of the analyses for the present study 
are based upon these five groups, 16 in each. 
A comparison of mathematics grades for these 


groups indicated no significant ' differences 
among them. 


Procedure 


The procedure for administration during ini- 
tial learning involved the presentation of learn- 
ing programs to students in 11 booklets on 11 
successive class days. Those students in Treat- 
ment EO started later than the other students» 
since their material was presented in 8 booklets, 
rather than 11. In addition, among the various 
classes of students (each class containing equa! 
numbers of students in each experimenta 
treatment), some variations occurred in the 
total number of days during this learning 
period, owing to differences in feasibility ° 
scheduling classes for experimental use. Ac- 
cordingly, the tests of achievement which fol- 
lowed learning were admi istered to the vari- 
ous classes on 2 successi e days during the 
period March 1-8, and this time represents the 
termination of original learning. 

On the days May 9 and 10, tests of reten- 
tion were administered to all groups. The aer 
tention interval for the present study may 
therefore be stated as approximately 9 weeks: 
On the first of these days, the test given W3 
an achievement test containing items concep- 
tually identical with those used immediately 
after learning. The intention was to measure 
not only retention of the total final task, but 
also of those items of subordinate knowledge 
which may have contributed to it. 


Retention Measures 


The performance test given after the guste 
retention interval contained a variety of pro 


RETENTION OF NoNMETRIC GEOMETRY 


SPECIFYING SETS. 


POINTS, LI 


rp. spectty the 
intersect ion of 
a triangle and 
lines or parto 
of lines 

parte of Lines 


Ia. Specify the 
intersection of 
a triangle and 
lines or parta 
of Lines as 0, 
l, or 2 pointa 


IIb. Identify 
and draw the 
intersection 
lines or par 
of Lines tak 


ap 0 or 1 po 


IIIb. Identity 
and draw a ray 


Tila. Identity 
and draw a line 
sement 


Iva. Identity 
and draw a 


straight Line 
of points 


Via. Identify 
separation of 
entities into 
groups 


Fic, 1 


e acqui 
ng sess 


Hierarchy of learning sets to b 
is during the original learni 
Ms re 
Section, 
Points 
test wa 
Equivalent ; 
immed em in the performance te: 
different ely after learning, so as to present à 
tain ex, context and appearance, but to main- 
actly the same idea. Thus the con- 


Sar on the specification of sets, inter- 
tir sets, and separations of sets, using 
ines, and curves. Each item of this 


is . 
S constructed by deliberately alteri 
st given 


ng an 


AND SEPARATIONS OF SETS, USING 


two at a tine 


and draw 
separation of 
a line by a 
point into two 
half Lines 


IVb. Identify 
and draw inter- 
section of sets 


on 


INTERSECTIONS OP SETS, 


NES AND CURVES 


Id. specify the 
intersection 
set of a sirple 
curve and parts 
of Lines 


Ic. specify the 


11d. Identify 
and drav the 
separation of 
a plane by a 

a 


Ite. Idențify 
and draw the 
intersection of 
lines or parts 
of lines taken 
two at a tine, 
as nore than 


y 


ot 
ta 


int 


rita. Identify 
and drav a 
sinple closed 
curve 


Itte. Identity 


rva. Identity 
and draw a 
plane 


Ive. Identity 
and draw a 
curvo 


Va. Identify 
and draw a 
net of pointe 


VID. Identify 
and drav a 
point 


e learning program employed 
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ition was ™ 
a total of 


red as topics in th 
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ual content of the tw 


cogn: 
s scored for 


cept 
while specific item re 


possible. This test wa 


20 points. 

On the seconc 
ordinate learning 
subjects. Again, 
an exact correspondence 


a test of sub- 
nistered to all 
made to have 
the one ad- 


1 testing day, í 
sets was admi 


this test was 
with 
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ministered immediately after learning, in its 
conceptual content but not in the appearance 
of its items. It was designed to measure the 
performance of the subordinate knowledges of 
the hierarchy shown in Figure 1, specifically 
those designated as I, II, and III. Each of 
these subordinate knowledges was measured in 
two ways: (a) by an item of “intermediate” 
difference in context from that of the task as 
originally presented during learning, and (b) 
by an item of great difference in context from 
the originally presented learning task. (In the 
preceding learning study, three degrees of con- 
textual difference were employed, including one 
of “minimal” difference in context.) As it 
turned out, all results obtained with measures 
based on items of intermediate contextual dif- 
ference were essentially the same as those ob- 
tained with items of large contextual difference. 
Accordingly, only the former set of measures 
is reported here, in the interest of simplicity of 
presentation. For this measure of retention 
of subordinate learning sets, scoring was Pass 
or fail for each learning set at each degree of 
contextual difference. 


RESULTS 


The results of the study may be con- 
sidered as providing evidence in four 
major categories, as follows: 


1. To what extent are performances 
immediately following learning corre- 
lated with performances measured after 
a 9-week interval? 

2. How much retention was there? 

3. What were the effects on reten- 
tion of experimental treatments during 
learning? 

4. As compared to forgetting of final 
performances established during learn- 


ing, what happens to the retention of 
subordinate knowledges? 


Correlations of Measures of Immediate 
and 9-Week Retention 


For the total group of 80 subjects, 
the product-moment correlation between 
achievement scores immediately after 
learning and those attained after a 9- 
week retention interval was 62. This 
is a moderate relationship, and needs to 
be interpreted in the light of the fact 
that the reliability of the achievement 


test (according to data of the original 
study based upon 90 subjects) was 
found to be only .64, an uncorrected 
correlation for odd-even items. 

In contrast to this finding are the 
product-moment correlations of .41 be- 
tween scores on subordinate learning 
sets (of intermediate difference in con- 
text) measured immediately and after 
9 weeks; and .46 between scores on 
learning sets of great difference in con- 
text measured on these two occasions. 
These are low correlations, obtained on 
measures which have un¢orrected re- 
liabilities of .90, by odd-even correla- 
tions obtained in the original group. 

These results may therefore be said 
to reveal moderately good consistency 
between initial and 9-week méasures on 
the final task, but a relatively low con- 
sistency between measures of subordi- 
nate knowledges on these two occasions: 
The implication is that during a period 
of potential forgetting, something dif- 
ferent may be happening to the reten- 
tion of a total performance and to the 
retention of subordinate knowledges 
Which support this performance during 
original learning, A further analysis of 


this effect is made in a subsequent 
section, 


Amount of Retention 


Retention of the final task was meas- 
ured by means of a 20-point achieve- 
ment test which, as has previously bee? 
mentioned, contained items identical in 
concept and different in appearance 
from items used to measure immediate 
Postlearning achievement, The retention 
of the 12 subordinate learning sets at 
Levels I through TIT (see Figure 1) was 
measured by a similar procedure. 
means and standard deviations of these 
measures for both occasions, and for 
the five groups of the experiment, are 
given in Table 1, 

As can be seen from an examination 
of Table 1, retention as measured bY 
Scores on the achievement test was very 
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TABLE 1 


MEANS AND Si 
AND STANDARD DEVIATIONS OF ACHIEVEMENT SCORES AND SUBORDINATE LEARNING SET 


Scores ATTAINED IMMEDIATELY FOLLOW: 


FOR THE FIVE EXPERIMENTAL GROUPS, 


ING LEARNING, AND AFTER 9 WEEKS, 
TOGETHER WITH RETENTION RATIOS 


(N = 16 in each group) 


Experimental group 


Skene El E2 E3 EA EO 
M SD M SD M SD M SD M SD 
Achievement 
(im i 
mediate) 12 ZA 10.8 3.5 97 37 10.4 40 10.0 3.8 


Achievement 
(9-week retention) 7.9 2.2 113 29 


10.9 3.2 10.3 3.3 1224 3.7 


Retention ratio, 

hence 78 1.12 1.20 1.08 1.28 
He et 88 33 84 3.0 9.2 29 8.9 33 9.2 3.0 
ie ee 49 19 64 13 éi 15 61 21 64 25 
(learning sets) 60 88 80 79 70 


ie ti all groups except El (the group 
ke hs narrow variety of examples 
tiie ee In fact, as the ratios 
groups , retention in the other four 
It mu Bee from 108% to 128%. 
the = of course be remembered that 
ately f ne achievement given immedi- 
addition oving, learning constitutes an 
these et practice period. Consequently, 
dinca achievement scores, 
hot be after a 9-week interval, can- 
Sites oe as uncontaminated 
Trion of reminiscence (cf. McGeoch 
ese a 1952, p. 162). Nevertheless, 
hat an i, do constitute good evidence 
y ‘bee ind of material, when learned 
instructional » a carefully constructed 
to forgetting. is highly resistant 
are hres in contrast to these findings 
hn ee oe retention of 
rough i learning sets; their losses 
erably orgetting appear to be consid- 
retentis ae As the ratios indicate, 
ranges fr of numbers of learning sets 
experimental 60% to 88% in the five 
Previous al groups. As shown in the 
hee US study (Gagné & Staff, 1963), 
subordinate learning sets are of 


tance to the achievement of 
k. But the present evidence 
suggests that their importance dimin- 
ishes once the final task has been 
achieved. Specifically, forgetting of 
subordinate learning sets may occur in- 
dependently of, and without effect upon, 
retention of the total task which has 
been achieved through learning. 


great impor 
the final tas! 


Effects of Experimental Treatments 


The results given in Table 1 also 
indicate the effects on retention scores 
of experimental treatments applied dur- 
ing the original learning sessions. The 
variances of scores for these groups are 
found to display nonsignificant differ- 
ences. But the means for achievement 
scores attained after 9 weeks differ 
significantly, when tested by means of 
an analysis of variance technique 
=4.46, df=4/75, b < 01). Applying 
a test to the differences of individual 
means (Dixon & Massey, 1957, p. 152), 
it is found that the mean of E1 differs 
significantly from that of EO at the 1% 
level, while other comparisons show no 
significant differences. Also at the 1% 
level, the mean of E1 differs from the 


“a 
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combined mean for the other groups. In 
other words, the only outstanding differ- 
ence among these means is that exhibited 
by Group E1, which is lower than all 
the others. 

As for the retention of subordinate 
learning sets, these means exhibit no 
significant differences among them. An 
analysis of variance applied to these 
values yielded F=1.85, df=4/75, p > 
10. Thus, the low retention scores of 
group E1 occur despite the fact that this 
group has retained subordinate learning 
sets not significantly less well than the 
other groups of the experiment. 


Retention of Subordinate Knowledges 


As results previously described have 
shown, retention of the capability of 
performing a final task appears to be 
better than retention of the subordinate 
learning sets which originally contribute 
to the learning of that capability. Some 
of these learning sets are forgotten, 
even though performance of the total 
task remains at a level as good as that 
originally attained. Are there differences 
in the pattern of retention for these 
learning sets immediately after learning 
and 9 weeks later? For example, do 
those at Level III (see Figure 1) tend 
to be forgotten, while those at Level I 
tend to remain, or vice versa? 

As previous studies have shown 
(Gagné et al., 1962; Gagné & Paradise, 
1961) the pattern of learning sets which 
an individual learner has attained dis- 
plays a remarkably regular pattern, when 
measured immediately following learn- 
ing. It is a pattern which implies that 
the learner continues to acquire learn- 
ing sets at higher and higher levels of 
the hierarchy until he reaches a particu- 
lar point, beyond which he acquires no 
more at all. (It is as if he “drops out” 
of the learning enterprise at this point.) 
Findings in the immediately previous 
study (Gagné & Staff, 1963) were en- 
tirely consistent with this general result. 

Examination of individual patterns of 


learning set retention, however, shows 
that these patterns are strikingly differ- 
ent. The forgetting of individual learn- 
ing sets appears to be irregular, or ran- 
dom. Learning sets at one level do not 
appear to be forgotten with greater 
frequency than those at another level. 
An illustration of this effect is given 
for a typical individual learner in Fig- 
Ure: 2. 

This irregularity of pattern may be 
measured as the number of disconti- 
nuities which occur in the score (pass or 
fail) of an individual on fearning sets 
when these are arranged in the order 
Ifa, IIb, IfIc, Id, Ia, IIb, IIc, 
IId, Ia, Ib, Ic, Id. For an individual 
who passes all of them, the discon- 
tinuities will of course be 0. For a stu- 
dent who begins to fail learning sets at 


some particular level, ideally expected: 


numbers of discontinuities would be 1. 
A score higher than this indicates by 
its size the irregularity of pattern ex- 
hibited in the attainment of learning 
sets. For the student whose scores are 
shown in Figure 2, for example, the dis- 
continuity score for learning sets meas- 
ured immediately after learning is a not 
atypical 1; but the score for the same 
learning sets measured after 9 weeks is 7. 

Such a discontinuity score was 
counted up for each subject in each 


l Fic. 2. Comparison of the pattern of learn- 
ing set achievement exhibited by one subject 
(JO) when measured immediately following 
learning (left figure) and on a test of reten- 
tion 9 weeks later (right figure). 
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TABLE 2 


MEA 
NS AN ‘ 
elie STANDARD DEVIATIONS OF DISCONTINUITY ScoR 
À f: SET ĪTEMS ARRANGED IN A NUMERICAL ORDER, 
EARNING AND 9 WEEKS LATER, FOR THE FIVE 


ES ON THE PASSING AND FAILING OF 
MEASURED IMMEDIATELY AFTER 
EXPERIMENTAL GROUPS 


(N = 16 in each group) 


B ee 


Learn; 
arning set measure El E2 


Experimental group 


M SD M SD M SD 


M SD MSD 
1.0 1.4 1.0 


Imm 7 
edia 
te 1,1 


fter 9 weal 1.1 


1.7 


1.1 
4.8 


ex . 
ta ase aoe The means and 
Presen deviations of these scores are 

sented in Table 2. 

Mean i table clearly indicates, the 
Sets Ra 9 scores for learning 
Mg are ese immediately after learn- 
ured afte arkedly less than those meas- 
ences tn 9 weeks. When the differ- 
using a these means are tested 
Ures) all E test (for correlated meas- 
eyond th ve turn out to be significant 
l of the 1% level of confidence. Thus 
ate aa on retention of subordi- 
Ston that "ie sets support the conclu- 
regular orgetting strikes them in an 
- and apparently random fash- 
our pite the fact that the final task 
than fone: these groups exhibits more 
Edges h /o retention, subordinate knowl- 
ular a forgotten in an irreg- 


DISCUSSION 
TI 


_ th 

tion o ki have shown that re 
'Mtersecti e final task of “specifying sets, 
et ) tiste of sets, and separations O 
eXtrem ing points, lines, and curves” is 
Whic ely high after 9 weeks during 
recall was encouraged oF Te- 


thin the school setting- The 


Ure 
t00 d retention was more than 
„mental 


O 
Sr Ds e four of the five expe! 
he fi the experiment, and 71% m 
&roup. Of course, this measure 
Provide cases affected by the practice 
achieye by the test used to measure 
ment immediately following the 


ten- 


Rite O 
Meat Wi 


5.0 1.6 


1.3 
4.9 


1.4 6 


1.2 17 


1.5 4.8 
ng. It is reasonable to 


original learni 
e retention as remark- 


characterize th 


ably good. 
The finding that, in one group, Te- 


tention of the final task was lower than 
all the rest deserves further comment. 
This experimental group (E1) origi- 


nally learned by means of an instruc- 
am which contained several 


tional progr 
examples of minimal variety following 
the attainment of each learning set (ie, 
topic) in the program. The results 
therefore show that, so far as retention 
is concerned, such a treatment is less 
effective than that used for Group EZ, 
containing examples of intermediate 
variety, as well as that for E3, with 
examples of maximal variety. But the 
remarkable thing is that the “minimal 
variety” of examples used for El seems 
also to have been less effective than 
no examples at all, which was the treat- 
ment accorded Groups EO and EA. (It 
will be recalled that “no examples” in 
this context means none beyond the 
original presentation of the subordinate 
task. Actually, each task of the hier- 
archy occurred at least once during the 
learning, in all groups, “examples” 
means those instances of the task be- 
yond this initial one.) It therefore 
appears from the present results that 
the presentation of additional examples 
of minimal variety has had an actively 
deleterious effect upon retention. 

This particular finding is not an easy 
one to account for, in terms of hypothe- 
sized mechanisms of forgetting. It is 
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possible, however, that any treatment 
which tends to prevent the generaliza- 
tion of subordinate knowledges has an 
adverse effect upon their later recall and 
use, The subordinate learning sets in a 
hierarchy (such as that of Figure 1) are, 
after all, supposed to operate in both 
learning and retention by continually 
generalizing to new situations, whether 
these are in the “higher level” learning 
sets or in the execution of a final task. 
It is conceivable that repetition of these 
subordinate tasks within a narrow con- 
text serves to reduce their generaliza- 
bility, as is true with simpler habits 
(LaBerge, 1961). Such a narrowing of 
generalizability might reduce the effec- 
tiveness of these learning sets to a point 
even below that attained by learning 
not attended by any additional “ex- 
ample practice,” as in Groups EO and 
EA. 

We do not feel entirely confident of 
this finding, and even less so of our 
proffered explanation. A replication 
should certainly be carried out, and if 
it is verified, additional studies need to 
be undertaken to explore thoroughly 
the limits of the effect of “narrow repe- 
tition” on retention of meaningful sub- 
ject matter. 

The remaining finding of considerable 
significance in the present study is the 
differential, random seeming, forgetting 
of subordinate knowledges over the 9- 
week period, occurring at the same time 
as high retention of a capability for 
performing the final task. Tt- has often 
been supposed that learning sets, in 
such an instructional sequence as this, 
may have a positive function in learn- 
ing which is not displayed (or required) 
in the final performance. The subordj- 
nate learning sets, it has been said 
(Gagné & Paradise, 1961), “mediate 
positive transfer of training” to higher 
level learning sets. Once they have per- 
formed this function, however, they may 
suffer forgetting, or “drop out.” Ap- 
parently, this is what happened to many 
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of the learning sets included in the 
instructional sequence of the present 
experiment. As opposed to the build- 
ing-block character they have when 
measured immediately after learning, 
they disappear in the irregular fashion 
depicted in Figure 2. 

What are the consequences of the 
forgetting of these subordinate knowl- 
edges? If one is dealing only with a 
particular capability, such as that pro- 
vided in the final task here employed, 
there are no adverse consequences; the 
student can still perform. capably on the 
final task. However, it is an important 
consideration that these same subordi- 
nate knowledges may have to perform 
this learning function again, when the 
student is asked to learn a new task. 
And if they are not recalled at that time, 
as our previous studies have shown, 
learning will not occur, 

Forgetting is a process which takes 
place all the time. The forgetting of 
those subordinate knowledges which 
may be needed in the learning of a new 
task is something which probably should 
be expected to happen in a more ot 
less unpredictable way. The variables 
used in the present experiment (increas- 
ing variety of examples, provision of 
time following example practice) have 
not been shown to be effective in pre- 
venting forgetting. Taken as a whole, 
therefore, the results emphasize the 
Practical importance of review in any 
Sequence of instruction. An instruc- 
tional program accomplishes this by re- 
quiring systematic recall of previously 
learned knowledge before asking the 
student to achieve a new item of knowl- 
edge. In this somewhat indirect way» 
the importance of the “recall item” (cf. 
Gagné, 1962) for effective learning 15 
again emphasized. 

Our experiment provides no hint 35 
to how some learning sets come to b° 
retained in any near permanent fashion- 
A best guess would be that such reten” 
tion is fostered not primarily by “variety 


J 
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of learning context” (as used in the 
present experiment) but rather by 
variety of use.” If a given learning 
set is used to support the learning of a 
great variety of higher-level knowl- 
edges, perhaps this kind of variety 
makes it more recoverable and less sub- 
= to forgetting. This is an interesting 
peculation, which cannot, however, be 
Supported by any currently available 
evidence, 


SUMMARY 


ace oe was:carried out to measure 
the ee of knowledge described by 
fits, of of “specifying sets, intersec- 
Tae of sets, and separations of sets, 
as of Ponts, lines, and curves,” as well 
sets) cre baarhae knowledges (learning 
ing Msgr re 4 to the original learn- 
learnin this task. During the initial 
ome eens Tae groups of sixth- 
worked students, 16 in each group, 
stam hi through an instructional pro- 
but c aving the same topical content, 
ve Fda so as to constitute 
roup ai experimental treatments. 
Subordi l practiced examples of each 
variet: nate task which had minimal 
median aN’ eones Group E2, inter- 
variety. variety; Group E3, great 
Gra de Group EO, no examples; and 
in pl A, unrelated tasks (arithmetic) 
ace of examples. 
besa was measured after a 
result, of approximately 9 weeks. The 
S were as follows: 

Gious E mean retention score of 
at of l was significantly lower than 

., Of the other groups, whose means 
eviden ot differ from each other. This 
e nce suggests that “narrow practice” 

en ples has a negative effect on 
Vanta on. At the same time, no ad- 
creased ìn retention was found for in- 

E variety of task examples. 

as „cept for Group El, retention 
of Beg than 100% by comparison 
follo: res on a test given immediately 
Wing learning and on a test with 


ret 


items of identical conceptual structure 
given 9 weeks later. (Item appearance 
was entirely different on the two oc- 
casions.) It is pointed out that the first 
test constituted a practice trial, and that 
true “reminiscence” cannot therefore 
be said to have occurred. But retention 
in these four groups was very high. 

3. In contrast with achievement 
scores, the percentage of retention of sub- 
ordinate learning sets ranged only from 
60% to 88%, indicating considerably 
greater losses. In addition, the pattern 
of forgetting revealed by the retention 
test of learning sets was found to be an 
irregular one in contrast to the pattern 
of these subordinate knowledges ex- 
hibited immediately after learning. 
These results are interpreted as throw- 
ing light upon the manner of “dropout” 
of subordinate knowledges, and empha- 
size the importance of brief “recall 
items” in a sequence of instruction for 
acquiring new knowledge. 
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PORTS | 
FFERENCES IN PARENT AND CHILD RE 
i OF THE CHILD’S EXPERIENCE IN THE 


USE OF MONEY 


HELEN R. MARSHALL1 
Drexel Institute of Technology 


This investigation of the meaning of differences in parent and child 
reports of the child’s experience analyzed differences in reports about 
recent use of moncy by 180 children aged 10-12 years. The results sug- 
gested that parent and child reports are not similar enough to be inter- 
changeable, that differences between reports relate to child character- 
istics, and that child reports are more closely related to other variables 
than are parent reports, A complementary study of interrelations of 
the various measures indicated that children’s financial knowledge does 
not differ from other knowledge in its association with IQ of the child. 


Research about home determinants 
of children’s behavior is plagued by 
many problems of measurement. Among 
these is a lack of knowledge of the 
meaning of differences in parent and 
child reports of the child’s experience. 
This investigation explored this prob- 
lem through analysis of differences in 
parent and child reports of the child’s 
use of money in the past week and year. 
Such home experiences appeared to lack 
emotional overtones leading to gross dis- 
tortions, and to be of enough interest 
to both parents and children to be Te- 
membered. 


Exploration of differences focused on 
three questions: 


1. How much do parent and child 
reports agree and disagree? 


2. Do characteristics of the child 
contribute to differences? 


3. Whose reports bear closer relation- 
ships with other variables? 


1 The investigation reported in this paper 
was conducted in part in connection with a 
project of the Home Economics Department 
of the Kentucky Agricultural Experiment Sta- 
tion and is published with permission of the 
Station Director. It was written after the 
author was employed elsewhere. 
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A secondary purpose was to study 
interrelations of measures ‘used in the 
analysis of differences, i.e., parent and 
child reports of the child’s use of money; 
children’s tested characteristics, and 
children’s scores on tests of financial 
knowledge and responsibility, This 
phase of the study centered on testing 
the hypothesis that children’s financial 
knowledge does not differ from other 
knowledge in its association with 1Q of 
the child. Relations between children’s 
financial knowledge and both home ex- 
periences and some child characteris- 
tics were investigated by Marshall and 
Magruder (1960), but the influence of 
IQ was not explored in that study. 


METHOD 


The subjects were 180 children and on? 
parent of each who resided in the same agti 
cultural region of Kentucky, although in dit- 
ferent counties, as the children studied 
Marshall and Magruder, The sample co?” 
sisted of 30 boys and 30 girls at each of the 
ages of 10, 11, and 12 years, selected from 7 a 
children tested at county consolidated schoo 
to fill an analysis of variance design for 4” 
other study (Marshall, 1963), ” 

The sample included all levels of socioe® 
nomic status, as determined by the Comi. 
15-point scale (Danley & Ramsey, 1959). Tag 
mean IQ from the California Test of Ment? 
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Maturity (1957 edition) was 102, and the 
standard deviation was 15. 
eee Sn ana individual tests and questions 
fire ministered to the children at school in 
the eons within a period of 2 weeks by 
ioe and assistants. Parents were 
end at home within the following 
fe following child experiences were in- 
_in the study of differences in parent 
and child reports. 


Pi et ass with Money test (Marshall 

Ferrite iet easel A high score on this test 
5 ie a wide variety of experience. 

the emia week’s wages—the amount earned by 
3 a at home and elsewhere. 

Ra PE wages—the sum of amounts 
4. P paid for any job performance. 

dign year’s gifts of money from any 
5. tae of allowances. 

sollte week’s spending money from any 

ekg Tiber of expenses assigned to the 

»SPendii spending money. The number of 14 

ing i categories (food snacks, toys, cloth- 

parse ts, school needs, dues, etc.) that both 

if at Wie child stated had to be purchased, 

, from the child’s spending money- 


eniberence scores for the first four experi- 
Paranie oe determined by subtracting the 
a const report from the child’s, and adding 
Mean ine to make all scores positive. The 
Past w ifference between three reports of the 
dilere s spending money was used as the 
Was us ce score for the fifth experience, and 
Spending, also as an estimate of variability of 
Were ie money. Two of these three reports 
ent, nom interviews with the child and par- 
Mitial į the other was written on the child’s 
i information sheet. The number of spe- 
atop nes that both parent and child 
Was tied were assigned to spending money 
EX perje: as an agreement score for the fift 
Ch nce, 

tugy ap etistics of children included in the 
on F interrelations were chronological age, 
02 the ch California Test of Intelligence, soe 
astan hildren’s Manifest Anxiety CMA scale 
Dumber: McCandless, & Palermo, 1956)» 
Status * of siblings, and family socioeconomic 

e On the Cornell scale. 
howled estimates of children’s 
follows. £° 2nd responsibility employe 
: (a) The Financial Knowledg 


Spe a 13 multiple-choice question test 
With fan this study, Questions were concerned 
ative mily money management, and with rel- 
costs of food, clothing, and cars. 


e Test 


The Coin test estimated accuracy in pricing 
inexpensive toys, as described by Marshall and 
Magruder (1960). (c) The numerical reason- 
ing score was obtained from a subscale of the 
California Intelligence Test. (d) The Harris 
scale concerned “behavior classifiable as reli- 
able, accountable, loyal, or doing an effective 
job” (Harris, 1957, P. 322). (e) The Lie 
scale included in the CMA scale was used as 
an estimate of irresponsibility, on the assump- 
tion that realistic description of self is an 
aspect of “accountable” behavior. (f and g) 
Parent judgments of responsibility for money 
and work compared the child to siblings and 
the child’s classmates known by the parent. 


RESULTS 


Parent and child reports of the same 
child experience had a slight resem- 
blance, as is shown in Table 1. These 
small 7’s do not support assumptions 
that the reports are identical, inter- 


changeable, or reports about the same 


experience. 
The r’s between two reports of the 


same experience contrast sharply with 
r of .87 obtained between parent and 
child reports of home furnishings and 
equipment on the Cornell Scale of Socio- 
economic Status in this sample. Agree- 
ment about possessions was significantly 

reater than agreement about an experi- 
ence of the child. 

One reason for the difference in par- 
ent and child reports is suggested by 
their mean report scores shown in 
Table 1, Children said they had more 
experience using money than their par- 
ents reported, and this difference was 
significant at the .01 level for all topics 
except the Experience with Money score. 

The size of the difference between 
child and parent reports was extremely 
variable and often very large. For the 
several reports of amounts of money, the 
range of differences was more than eight 
times the size of the mean of either child 


or parent reports. 

Parents and children did not differ 
consistently over the five experience 
topics listed in Table 1. Intercorrela- 
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TABLE 1 


CORRELATIONS BETWEEN AND Means oF 180 CHILD AND PARENT REPORTS OF THE 
CHILDS EXPERIENCE 


Mean of reports by 


Topic of report r Children Parents 
Experience with Money score 33** 11.7 hae 
Past week’s wages or $ ar $ z 

ast year’s wages — =- i 
e Boys Aa $46.36 $39.01 
Girls 16* $23.46 $11.54 
Past weck’s spending money f 
Interview week Sys $ 69 $ 60 
Information sheet week .18* $ 1.06 
Number of assigned expenses .20* 48 ” 3.9 
a Sex difference in r’s and between means significant at .0S level. 
* p= 05. 
p= 01. 


tions of these difference scores failed to 
exceed + .14 in size. 

The possibility that child characteris- 
tics contributed to differences in reports 
was explored by correlating difference 
scores with the child characteristics 
listed in the first column of Table 2. 
Significant 7’s were obtained for chon- 
ological age, IQ, the two money knowl- 
edge tests, and the Harris Social Atti- 
tudes Scale. As scores on these child 
characteristics increased, the child and 
parent agreed on more assigned expenses 
(rs from .17 to .28), and the child’s 
estimate differed less from the par- 
ent’s report of variety of experiences 
and of the past year’s gifts (from 
—.17 to —.27), These correlations sug- 
gest that older, brighter, more knowl- 
edgeable, and more responsible children 
differed less from their parents in re- 
porting some topics than their less 
favored age peers. 

Significant 7’s for difference scores 
involved the same characteristics and 
test scores as those shown for child re- 
ports in Table 2. Correlations involving 
parent reports, shown also in Table 2, 
were less often significant. Difference 
scores and child reports varied in ac- 


cordance with the child’s other charac- 
teristics, while parent reports often did 


not. In short, child reports were more , 


closely related to other variables than 
parent reports of the same experience. 
Child reports had 19 significant 7’s with 
child characteristics and knowledge, ex- 
clusive of relations for variability of 
spending money, and those involving 
sex differences, in contrast to 8 signifi- 
cant 7’s involving parent reports. 

The second part of this investigation 
was a study of interrelations of measures 
used in the preceding analysis of differ- 
ences, particularly in regard to their 
support for the hypothesis that chil- 
dren’s financial knowledge does not dif- 
fer from other knowledge in its asso- 
ciation with IQ of the child. 

The obtained correlations support 
this hypothesis, and also provide evi- 
dence that IQ had closer relations with 
children’s financial knowledge and re- 
sponsibility than any other factor in- 
cluded in this study. A comparison of 7’s 
involving IQ with r’s involving other 
variables in Tables 2 and 3 makes this 
clear. For example, correlations between 
IQ and determinations of children’s 
financial knowledge and responsibility, 
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TABLE 2 
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Corr : v1 
aia OF Cuitp AND Parent Reports oF THE CHILD'S EXPERIENCE WITH ESTIMATES OF 
HILDREN’S CHARACTERISTICS, FINANCIAL KNOWLEDGE, AND RESPONSIBILITY 


Child’s experience as reported by child (C) and parent (P) 


Experience Number Past week’s P ,, 
. with _ of assigned spending Seach Past year’s 
Estimates money expenses money AES WEES: 
Cc P € P Cc d C r c P 
Pi o 2 a a g w a o lF OB 
CHA scale a T A 18* 07 04 —.13 07 —.07 14 
Sh i J s 05 01 o1 —01 —.04 11 06 
siblings —19* i —.03 
te AE .05 02 os —13 —09 —.08 —.08 —.02 
Status 19* * kk ** $ g 
Baia ‘ 16 20 11 29 08 07 12 ape ast 
ene 06 05 1s* 06 20** 12 os —.10 03 06 
i .09 JI =. =0 ai 02 —. —.05 
Numeral 03 7 23 06 o 10 05 00 
Hae 10 08 23e* 17* 11 —.05 05 08 Fv 22 
ln s eg 04 03 — 4 05 05 06 —.02 —.02 08 
Ben ae —.15* —.08 —.18* —.14 14 09 16* —.05 13 =.06 
ronib 
or money 15* = | 08 30%* .22** 05 12 11 ie 
Responsibility i ` i 
orwork  —.03 03 40 —07 —12 02 00 08 = —.01 04 


^ Sex di! ; 3 
te fron: difference in r's significant at .05 level, In all i 


r's for 
p 


e yore negative (from —.03 to —-17). 
eh 5 


Ol, 


= in Table 3, were larger and more 
‘iii a icant than those obtained in 
of chr relations for the characteristics 
um ee age, manifest anxiety, 
status of siblings, and socioeconomic 
larger Also, these correlations were 
torrela more often significant than 
edge a ions between the seven knowl- 
child in responsibility scores and either 
report eports of experience or the similar 
cae by parents, shown in Table 2. 
Mone eral aspects of experience with 
know were associated with financial 
not oe and responsibility in ways 
for, itea for by IQ. Children’s re- 
closer ar experience with money had 
Status relations with socioeconomic 
and chronological age than with 

» as is shown in Table 2. 


nstances, 


r’s for boys were positive (from .17 to .43), but 


Obtained correlations suggest that 
three aspects of the child’s experience 
with money relate to children’s financial 
knowledge and responsibility. 

1. The number of expenses the child 
stated were assigned to his spending 
money correlated positively with knowl- 
edge of money and negatively with the 
Lie scale, as is shown in Table 2. This 
aspect of experience also had positive 
relations with determinations of re 
sponsibility for boys, but not girls. 

2. Receiving more weekly spending 
money accompanied more knowledge 
and a more favorable judgment about 
money responsibility from the child’s 
parents, as is shown in Table 2. These 
positive relations were not the conse- 
quence of differences associated with op- 
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TABLE 3 


CORRELATION OF CHARACTERISTICS OF CHILDREN WITH THER FINANCIAL KNOWLEDGE AND 
RESPONSIBILITY SCORES 


Number Socio- 

‘4 onsibility scores CA IQ CMA of economic 

See scale siblings status 
Financial Knowledge Test 31** ee —.08 —.15* 15* 
Coin Test of Knowledge of Money 2 21** 592 = fa 09 
Numerical reasoning — 06 ie — 22% =a 16 
Harris Social Attitudes Scale on 47 —.35** _ 18) et 

i 24% ft 15* 02 : 
Lie scale = x J 
Parent judgment money responsibility 09 .15* =01 ST —a 
Parent judgment work responsibility — 04 -09 —.03 —.15* 17* 


a Sex difference in_r’s significant at .05 level. 


Between 10 and the Lie scale, the r for boys was —.44, and 


was .02 for girls. The r between socioeconomic status and money responsibility was .32 for boys and —.19 
for girls, 

p= 05 

** p= 01 
portunities to earn money. Wage There was a suggestion of, a differ- 


amounts failed to relate to financial 
knowledge and responsibility, 

3. Variability in the weekly amount 
of the child’s spending money correlated 
positively with financial knowledge 
(.17) and the Coin test (.18). However, 
variability of amount had an v of 74 
with the total amount received in 3 
weeks and may not bea separate factor. 

Relations for these three aspects of 
experience give added details and sup- 
port for the conclusion by Marshall and 
Magruder (1960) that children’s finan- 
cial knowledge increases as the child’s 
spending money increases. 


DISCUSSION AND CONCLUSIONS 


The evidence of this investigation sug- 
gests that research use of either the 
child or parent report of the child’s ex- 
perience will have the consequence of 
different results than would be obtained 
with use of the other. Use of the child 
report seems to increase the number of 
relations obtained for home determinants 
of behavior, while use of the parent re- 
port could eliminate relations involving 
personality factors that contribute to 
differences in child behavior. 


ence in the importance of reports to par- 
ents and children. All child interviewers 
spontaneously described the children’s 
delight in the opportunity to describe 
their experiences. When asked, parent 
interviewers said, “Parents attempted 
to give full and honest reports.” This 
Possibility could explain the greater de- 
tail found in child reports. Perhaps a 
difference in the importance of situa- 
tions to parents and children will be a 
cause of differences in reports of any 
experience. 

In this investigation of the meaning 
of differences between parent and child 
reports of the child’s use of money, the 
results suggested that: 


1. Child and parent reports of the 
same experience of the child are not 
similar enough to be interchangeable. 

2. Parents and children do not differ 
consistently in their reports about sev- 
eral experiences. 

3. The size of the difference is influ- 
enced by general characteristics of the 
child. In general, as “desired” charac- 
teristics of the child increase, the size 


of the difference between reports de- 
creases. 


Jj 
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4. Child reports vary with the child’s 
oc while parent reports often did 
not." 

5. Child reports have closer relations 
with other variables than parent reports. 

The analyses of intercorrelations of 
measures indicated that children’s finan- 
cial knowledge does not differ from 
other knowledge in its association with 
IQ of the child. The results support 
two conclusions: (a) IQ relates more 
closely to children’s financial knowledge 
and responsibility than any other fac- 
i sci for' these 10-12 year old 
iene and (b) assignment of specific 
os vee to spending money and the use 
of ed and relatively large amounts 
one ing money had closer relations 

ility g] knowledge and responsi- 
aise than the other experiences in- 
ed in children’s reports. 
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ITEM SCRAMBLING IN 


A SELF-INSTRUCTIONAL 


PROGRAM * 


GERALD R. LEVIN asp BRUCE L. BAKER 


Brown 


University 


A 4-unit, self-instructional program on geometry was used to study 


the effect of presenting program 


items in standard or random order. 


36 2nd graders, divided into 2 matched groups, went through 2 versions 
of the program which differed only with respect to the sequence of 
items in the 3rd unit. The control group went through those items in 
the standard order; the experimental group in a random sequence. 
No statistically significant differences between the groups were found 
on indices of acquisition, retention, or transfer. The generality of the 
findings was discussed in light of program effectiveness and the correla- 


tion of IQ and performance. 


Decisions about the sequence in which 
material is presented are inherent in the 
process of constructing self-instructional 
programs. In a program designed to 
teach several concepts, one concept must 
be selected for initial treatment. If 
10 items are used to teach a concept, 
these items must be ordered. While 
every programmer must make assump- 
tions about ordering topics and items, 
there is little experimental evidence 
available which bears on the validity of 
such assumptions. 

Gavurin and Donahue (1961) have 
conducted an experiment directly rele- 
vant to the question of item sequence. 
They used the first 29 items of a pro- 
gram on psychology (Holland & Skin- 
ner, 1961) and presented them in a 
standard sequence to one group of 
adults, and to another group in a ran- 
dom sequence. Their method of scram- 


1 The research reported herein was supported 
in part by Grant No. 7-07-088.00 from the 
United States Office of Education, Department 
of Health, Education, and Welfare, 

The authors are indebted to E, Fitzgerald, 
Superintendent of the Bristol, Rhode Island, 
School Department for his cooperation in 
facilitating this research. A. Hilton’s and 
N. Maurer’s assistance in the collection and 
analysis of data is gratefully acknowledged. 


bling items was a combination of what 
might be termed block scrambling and 
item scrambling. The 29 items were 
divided into blocks of 10, 10, and 9 
items. The order of blocks was scram- 
bled for the experimental group. Within 
each block, the 9 or 10 items also were 
scrambled so that the final random order 
contained more local homogeneity than 
would have been expected if scrambling 
had taken place within the total pool 
of 29 items. The subjects were required 
to reach a criterion of an errorless trial 
on all 9 or 10 items within a block be- 
fore moving on to the next block. It 
was found that the group which went 
through the items in a random sequence 
required significantly more trials to cri- 
terion and made more errors during aC 
quisition. However, when retention W45 
tested a month later, the superiority ° 
the group which went through the stand- 
ard sequence of items was not statisti- 
cally significant. Unfortunately, the de- 
sign of their study did not permit 4 
comparison between the two treatments 
with the number of trials held constant 

The present experiment, like the study 
by Gavurin and Donahue, was c0" 
ducted to determine the importance ° 
presenting items in a standard, logic# 
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sequence which had been arrived at on 
the basis of prior planning and experi- 
mentation. The original impetus to the 
study was a concern that if a program 
were eventually to be evaluated in terms 
of criteria of retention and transfer, then 
o rate during acquisition might not 
eo criterion to use while 
sig a program. Accordingly, the 
olen espe of program items 
ae to be a convenient means of 
wails came rate during acquisition 
Sin. ‘ee ing other program character- 
stüdy — The purpose of the 
ped o, was to determine what hap- 
Wien nE varied criteria of learning 
hortlon m sequence was varied in a 

of a self-instructional program. 


METHOD 


A 

whidh wee eo, experiment was planned 

effects of scr make it possible to examine the 

of a a E item sequence in one unit 

sition, (b) on (a) error rate during acqui- 

Of the pr performance on a subsequent unit 
Program, and (c) performance on an 


achieve; 
transfer test which measured retention and 


Subjects 


ene 36 
onth of 
These 13 
among 81 
classes F 


subjects were all pupils in the last 
at second grade in a public school. 
Oys and 23 girls were selected from 
children who were present in three 
1 ‘as Pe hen day a screening test, Test S, 
ected from ered, The final sample was sè- 
Screening among those who met the initial 

additio criteria by subsequently dropping 
dro mal children, Three children were 
first two ecause of poor performance on the 

chila units of the program. Subsequently, 
ropneg De, each experimental group was 
the exp because of procedural errors during 
Sample crimental treatment. Thus, the final 
each, consisted of two groups of 18 subjects 


Bot 

ad a experimental and control groups 
Viations ages of 7.6 years with standard de- 
of the oe 6 years. The mean IQ (Otis tests) 
ard dite group was 107.0 with a stand- 
Menta) ction of 11.3, while for the experi- 


al 
1074 and 14 the corresponding figures were 


Instruments 


The research instruments included two forms 
of a specially developed self-instructional pro- 
gram, teaching machines for presenting the 
programs, and two tests. 


Programs 


The seli-instructional program, informal 
geometry for the second grade,? had been de- 
veloped through a process of trial and revision 
as suggested by Skinner (1958). A validation 
study had established that the program pro- 
duced a statistically significant amount of learn- 
ing, but was not highly effective in promoting 
mastery of the material. 

The program consisted of 1 
steps, grouped in five units: 
Lines, Angles, and Triangles. Alpha was de- 
veloped to use while teaching children how 
to manipulate the teaching machines and did 
not contain any geometry items. The other 
four units comprised a linear sequence in 
which concepts and notation taught in one 
unit were used and built upon in subsequent 
units. The program had a mean of 6.7 words 
per item. Only 99 different words were used 


in the program and the type-token ratio for 
the program as à whole was .08. The 15 second 
h the program in the 


graders who went throug! 
validation study, had a median error rate of 
22.2% for the total program and took a 
median time of 59.9 minutes to go through 
the items on their first exposure to them. 

The only portion of the experimental pro- 
gram which differed from the standard form 
was the unit on angles. The angles unit was 
selected for experimental treatment because 
of its difficulty and because of its position in 
the program. Previous results indicated that 
the angles unit was the most difficult. More- 
over, the fact that the unit on angles came 
midway in the program made it possible to 
compare the treatment groups with respect to 
acquisition before and after the experimental 
treatment, as well as during it. 

In the standard program 
——— = 

2A 19-page technical report, including a 
specimen copy of this program, has been de- 
posited with the American Documentation In- 
stitute. Order Document No. 7515 from ADI 
Auxiliary Publications Project, Photoduplica- 
tion Service, Library of Congress; Washing- 
ton 25, D. C., remitting in advance $1.75 for 
microfilm or $2.50 for photocopies. Make 
checks payable to: Chief, Photoduplication 


Service, Library of Congress. 


80 items, or 
Alpha, Dots, 


the unit on 
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angles consisted of 60 items which were pre- 
sented on three strips, each containing 20 items 
(see Figure 1). In the experimental form of 
the program the order of these three blocks 
of 20 items was held constant, while the or- 
der of the 20 items within each block was 
randomly scrambled. The rank-order corre- 
lations between standard and random item 
sequences in the three blocks were —.17, —.28, 
and —.07, respectively. 

Program Presentation. The program was 
duplicated on 81⁄4 X 42 inch strips of paper by 
the ozalid process and these strips were pre- 
sented by means of Foringer 2002 teaching 
machines. The items were spaced so that it 
was impossible to see portions of two items 
at once. The children wrote their composed 
answers on a standard answer strip. 

Tests. Two achievement tests had been de- 
veloped for different purposes. Test S was 
designed for quick screening purposes. It was 
designed to screen out the subjects whose verbal 
comprehension was too poor for them to un- 
derstand the program, and the subjects who 
were well acquainted with the material to be 
covered in the program. Test S consisted of 
2 mimeographed pages containing 8 verbal 
comprehension items and 8 geometry items. 
Test 1 was developed to provide a means of 


18, 
Is dot B on line AB and line EC? 


19. 
When two straight lines meet at 
the same dot they make an angle. 
Do lines AB and BC make an angle? 
A 


ot 


20. 
Do lines EF and FG make an angle? 
F 


21. 
Do AB and XY make an angle? 


22, vi 


Is this an angle? 


assessing what a child learned by going through 
the program. The 52 items were grouped 
homogeneously on 7 mimeographed pages. 
Spearman-Brown corrected split-half reliabili- 
ties for Test S and Test 1 were .68 and .87, 
respectively. 


Procedure 


The experiment began when the screening 
test was administered to the children in their 
classrooms. It ended 17 days later. During 
the experiment every subject participated for 
about 15 minutes every day, with only minor 
exceptions. 

After the initial screening, all subsequent re- 
search sessions were carried out in a psy- 
chological laboratory in the basement of a 
nearby school. Most of the subjects had gone 
to first grade in this school and it was com- 
mon for pupils to go to this school building on 
errands, 

The subjects typically went fròm their class- 
rooms to the laboratory in groups of four. 
Members of the experimental and control 
groups came in the laboratory simultaneously 
and in approximately equal numbers at all 
stages of the experiment. Two or three experi- 
menters were in the laboratory at all times, 


Do CD and DE make an angle? 
D 


24. 
How Pies straight lines in this 


angle’ y 


Is this an angle? 
5 ` 
o 
R 
26. 
How many straight lines in this 
angle? Pn 


25, 


27. 


Are all angles made of straight 
lines? 


Fic. 1. Sample portion of the standard angles unit. 
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. and they timed each chi 
segment with stop s cain R 
Pie ao, and Pretraining. In their first ses- 
a e laboratory, the subjects were in- 
taught ee en the first 5 pages of Test 1, and 
asin ae use the teaching machines while 
fiona ona Unit Alpha of the self-instruc- 
añ poe The next day pretraining be- 
through the pretraining each subject went 
Aftse Sora F units on dots and on lines twice. 
subject ae eting the second trial on lines, each 
WHS en as retested with 3 pages of Test 1 
Aie, vered the units on Dots, Lines, and 
M stag Treatment. The subjects were 
groups ek r assigned randomly to treatment 
angles item e basis of their scores on the 
tration of T given during the first adminis- 
matching A s 1. The preferred procedure of 
administrati m on the basis of scores on both 
ance duc ions of Test 1, IQ, and perform- 
due to ti ing pretraining had to be foregone 

Kete oe pressures. 
vided in Ne no cues except for those pro- 
jects that iE program to indicate to the sub- 
e ened. procedure was different during 
roughout sige treatment than previously. 
old that diff e experiment, the subjects were 
ifferent mat erent children were working on 
uring th eal; i 
Went e experimental treatment each sub- 
am Ge ae each segment of the angles 
segment. imes before moving on to the 
Osttraini 

he aa and Posttesting. After finishing 
the final aoe all subjects were taken through 
Sented in ik of the program, Triangles, pre- 
naa form. All of the subjects 
Program on a Friday. On the 


finished i 
Ollowin, 
and Ter g onday, they all were given Test 1 


Ject 
Prog 
next 


Dat 
a 
to be Examined 


„mno 
item pes to determine the importance of the 
Were ee variable, several comparisons 
Mental oe Comparisons of the experi- 
Pretest aai. control groups with respect to 
termine Pretraining performance would de- 
larly bene they were performing simi- 
Mental oe the introduction of the experi- 
“ror dat: atment. An analysis of speed and 
Would the, during the experimental treatment 
te treatm be required to determine whether 
Ormance A was related to acquisition per- 
Pro erformance on the Triangles unit 
s oara scores on posttests, and com- 
whey Pretests and posttests would indi- 
er retention and transfer criteria of 
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PROGRAM UNIT AND TRIAL 


Fic. 2. Median error rates for each trial on 
each program unit. 


learning showed effects of the experimental 
treatment. Finally, correlations between 1Q, 
pretest scores, program scores, and posttest 
scores for each group would reveal how re- 
sponse measures interrelated, and whether such 
correlations would clarify group comparisons. 


RESULTS 


The data indicated that program per- 
formance through the experiment was 
similar for the experimental and con- 
trol groups. Table 1 summarizes time 
and error score for pretreatment, treat- 
ment, and posttreatment performance 
on the program. Mann-Whitney U tests 
indicated that none of the differences in 
Table 1 reached statistical significance. 
Figures 2 and 3 facilitate a more de- 
tailed examination of program perform- 
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Fic. 3. Median speed for each trial on cach 
program unit. 


142 Geratp R. Levin anp Bruce L. BAKER 


TABLE 1 


PROGRAM PERFORMANCE 


Median crrors 


Stage of training 


Median working 
time (minutes) 


Experi- Experi- 
Control ental rT Control ental T 
Sroup group sroup group 
Pretreatment 13.5 18.5 313.0 32.2 32.8 327.5 
Treatment 47.5 50.5 321.0 46.9 49.5 332.0 
Posttreatment 16.5 19.0 308.0 17.9 14.8 282.0 


a Smaller rank total. A rank total of 333.0 would indic: 


total of 271.0 would provide a p value of .05 


ance. These figures bear out the gross 
comparisons in Table 1. 

Table 2 makes it possible to see the 
effects of the experimental treatment on 
both specific and general measures of 
knowledge of geometry. Mann-Whitney 
U tests indicated that none of the com- 
parisons approached statistical signifi- 
cance. Additional comparisons of such 
facets of test performance as transfer 
items, nontransfer items, and individual 
pages of the posttest also failed to in- 
dicate any differences in performance 
between the two groups, 

Thus, group comparisons of acquisi- 
tion, retention, and transfer data all in- 
dicated that the experimental treatment 
did not have statistically significant ef- 
fects. 


TABLE 2 


Test PERFORMANCE 


ate identical sums of ranks for the two groups. A rank 


a 

Correlations were computed for sev- 
eral response measures to clarify the 
meaning of the group comparisons. In 
general it was found that measures of 
intelligence and quality of ‘performance 
in geometry tended to be correlated con- 
sistently, while measures of speed. of 
performance and gain from pretests to 
posttests were less consistent. Table 3 
summarizes the correlations for intelli- 
gence and three gross measures of 
geometry knowledge. 


DISCUSSION 


While the meaning of the results is, 
of course, subject to varied interpre- 
tation, the data certainly provide 1° 

TABLE 3 


SELECTED CORRELATIONS 
(N = 18 for each group) 


Experi- 
faa ned mental Smaller o Cow 
Test measure number median rank = tal 
correct moir totala Variables Control Experiment? 

Angles Pretest 1 2.5 20 332.  IQand pretest .24 so 
Angles Pretest 2 3.0 3.0 308.5 IQ and program 68** Ob 
Angles posttest 8.0 7.0 310.5 IQ and posttest 45* =F 
Angles gain 4.2 5.0 326.5 Pretest and program .52* A 
Total Pretest 1 31.0 29.2 306.0 Pretest and posttest 322 65" 
Total posttest 50.2 47.0 316.0 Program and posttest .g0*** 51 
Total gain 18.0 18.2 333.0 


ank total of 333.0 would indicate identical sums 
of ke for the two groups, A Tank Guta soe 
would have a p value of .05. 


to 
^ Pretest, posttest, and program scores refer 
number of items answered correctly. 
b = .05, one-tailed test. 
b= .01, one-tailed test. 
p = .0005, one-tailed test. 
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Support for the contention that item se- 
quence is an important variable in self- 
instructional programs. There was no 
Prage that item scrambling impaired 
earning. Moreover, the most reliable 
of the many statistically insignificant 
comparisons was in favor of the experi- 
mental group. 
ice correlations between measures of 
pi i ual differences at the beginning 
in he experiment with indices of learn- 
a oe that individual differences 
ie have obscured treatment effects. 
nee of the present data also indi- 
om a slight tendency for bright chil- 
than n the control group to do better 
re pa children in the experimental 
ir i w. hile the opposite trend appeared 
tleer rhe children. Thus, it seems 
Bee at the possibility of interaction 
effects + at ability and treatment 
Grey eserves explicit investigation. 
subjects it should be noted that the 
Weke 5a in the present sample probably 
intelli o more variable with respect to 
age pa than the children in an aver- 
v thet Gee classroom. Thus, indi- 
Se ifferences probably would be as 
as in ne in many classroom settings 
Prob cael experiment. - 
thon ae pid the most important limita- 
Of the e present study was the failure 
Present cr ei to teach the material 
jects ed thoroughly to most of the sub- 
ance id indicated in posttest perform- 
ar t seems likely that a more effec- 
Si a eg would have been made 
Wine a when scrambled. 
TER the present findings failed to 
Vener the assumption that item se- 
Dorp jis important, it seems neither 
on hips nor even tempting to aban- 
Presents hypothesis that the order of 
ito Te matters under some con- 
ang ~ instead, it seems useful to try 
equa ceptualize the problem more 
ately and operationally. 
18 intriguing to think of item 


scrambling as a means of dissecting a 
program so as to learn more about its 
sequential structure. When we hold the 
sequence of units, or blocks of items, 
constant and vary item order within 
blocks, as in the present experiment, we 
are in a position to learn about the “fine 
structure” of the program. When we 
reorder blocks of items and hold order 
constant within these blocks, we can ex- 
plore the “gross anatomy” of the pro- 
gram. A program consisting of totally 
unrelated items presumably would be 
found to have “no sequential structure,” 
as indicated by no differences in indices 
of learning, regardless of what we did 
to the order of items. In contrast, a 
program with “completely linear struc- 
ture” would be less effective if we tam- 
pered with its sequential structure in 
any manner, or to any degree. 

Tt seems likely that such dissection 
would reveal that most existing pro- 
grams are neither completely linear, nor 
completely lacking in sequential struc- 
ture. Moreover, such dissection might 
lead to a useful means of describing and 
comparing the sequential structures of 
programs. Finally, we may only know 
how much emphasis to put upon se- 
quence in programing when we can 
empirically characterize the sequential 
structure of self-instructional programs 
and have sound empirical generaliza- 
tions about the relationships between 
sequential structure, content, and de- 
pendent variables. 
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DECAY OF IMMEDIATE 


MEMORY FOR VISUALLY 


PRESENTED DIGITS AMONG NONREADERS 
AND READERS* 


LINDA F. ALWITT 
Study Center, Pediatrics, Albany Medical College 


The purpose of this study was to 
decay of memory traces, as a cont: 


examine 1 organism variable, rate of 
ributing factor in the low digit spans 


observed among cases of reading disability. 19 CA-matched reading dis- 
ability and control cases were given instructions before and after a visual 
presentation as to which line of a matrix of 8 digits to report. The lack 
of difference between the groups of Ss suggests that immediate memory 
traces of reading disability cases do not decay at a faster rate thin do 
those of normal readers. An incidental finding was that normal readers 


show a greater rate of increase in 


digit span with CA than do reading 


disability cases. Implications of both findings were discussed. 


Children with reading disability have 
often been reported to exhibit low audi- 
tory memory spans (e.g., Rose, 1958; 
Saunders, 1931) and low visual memory 
spans (eg., Rizzo, 1939; Rudisill, 
1956), They also show low visuotem- 
poral spans as measured by the visuo- 
kinesthetic Knox Cube Test (Robinson, 
1946, p. 153) and by tests which use 
successive rather than simultaneous 
presentations of visual stimuli (e.g., 
Hawkins, 1897; Rizzo, 1939). Since 
these children have low spans in visual, 
auditory, and kinesthetic modalities, it 
is likely that their deficit in digit 
span lies in intervening processes, in- 
cluding immediate memory, rather than 
in sensory input processes. Inasmuch 
as digit span is associated with reading 
ability, it is important to ascertain the 
causes of the low digit spans observed 
in cases of reading disability, 

The typical measure of memory span 
consists of the presentation of items to 


1 This study was supported in part by Public 
Health Service Project Grant OM 225 and by 
a research grant from the Association for the 
Aid of Crippled Children. Appreciation is ex- 
pressed to N. D. Bryant for his helpful com- 
ments on a draft of this paper. 


be recalled immediately. „Among the 
organism variables which limit the mem- 
ory span are: (a) the amount of ma- 
terial which the subject is capable of 
bringing to the processes of immediate 
memory, (b) the size of the subject’s 
capacity for storing immediate memory 
traces, (c) the rate of decay of immedi- 
ate memory traces, and (d) the rate of 
reporting trace material. The current 
study is primarily concerned with Gar 
amining one of these organism varia- 
bles, rate of decay of memory traces, 
among reading disability cases and nor- 
mal readers, 

Brown (1958) and Sperling (1960) 
have presented evidence that immediate 
memory traces decay with time among 
presumably normal readers. The low: 
ered digit span observed among read- 
ing disability cases can be due to 4 
faster rate of decay of immediate 
memory traces, compared with norma 
readers. 

The method chosen to study tracé 
decay was adapted from Sperling 
(1960), who sampled reports of stimuli 
seen in brief visual presentations. Sub- 
jects were auditorially cued as to whic? 
line of a visual matrix of letters and/ 
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meit to report, and samples of per- 
T mance were obtained. Sperling found 

at immediate memory for the visual 
presentations decreased as a function of 
a delay in cue instructions as to which 
ca of the stimulus matrix to report. 
cate may be interpreted as a re- 
i of the decay of immediate 

y traces with time. 


METHOD 
Subjects 


apa iien children with reading disabilities, 
the Alba eee in the diagnostic program of 
abilities, we Study Center for Learning Dis- 
to girls i were tested. The proportion of boys 
in accord this sample (17 boys and 2 girls) is 
serious re, ya the proportion found among 
iia ading disability cases (Vernon, 1957). 
affect then of girls in this sample should not 
een funn g since no sex differences have 
ory span for children with regard to mem- 
Wechsler a 1938). The mean 
Scale 10 mtella Scale for Children, Full 
The deere, this group is 984 (SD =9.0). 
LS years to reading ability of this group is 
asis of Ae ow their grade placements on the 
ecause e Gilmore Oral Reading Test. 
increase With eine has been shown to 
Kins, 126 age within this age range (Haw- 
cases were i Jacobs, 1887), reading control 
disabilit individually matched with reading 
age, The cases on the basis of chronological 
Population control cases were chosen from a 
in Grade of 60 public school boys enrolled 
Personnel. i through 6. As tested by school 
erage i ese boys were of average or above 
lPha o. ntelligence as measured by the Otis 
Brade Bia Beta, and were at or above their 
ows ioe in reading ability. Table 1 
ceme average chronological ages and grade 
nts for the two groups. 


Material 


Ei = 
inet a digits were typewritten in 34g inch 
âtrange Ype on white cards. The digits were 
Right f in two rows of four digits each. 
of the Arabic numerals 1 through 9 ap- 


Dea, 
Ted $ 
Once in each matrix, and an equal num- 


ber 

aT O A 

seq ; digits appeared in all of the 24 cards 
Pp 


“seq q the study. A Lafayette Tachitron was 
Posure Present the cards at a .l-second ex- 
Visible Ume. The area of the card which was 

the viewing aperture was 54g inches 


TABLE 1 


CHRONOLOGICAL AGE AND GRADE PLACEMENT OF 
THE READING DISABILITY AND CONTROL Groups 


Sample characteristics — Reading group 
Disability Control 
Chronological age 
(in months) 
M 127.2 127.5 
SD 15.5 15.7 
Grade placement 
M 4.0 4.8 
SD i Ki 1.2 


wide X 334g inches high, and was viewed from 
a distance of about 814 inches, 


Procedure 


Sperling’s (1960) results indicated that there 
was little difference between the amount 
of material available when cuing instructions 
were given .05 second before the stimulus 
presentation, and at the same time as the 
stimulus presentation. Based on this result, 
and in order to simplify the experimental 
technique, the two partial reporting conditions 
of the current study employed only precuing 
and postcuing instruction conditions. The pre- 
cuing instruction condition served to estimate 
presentation of the cuing instruction and the 
stimulus simultaneously. Therefore effects of 
attentional set, arising from instructions to pay 
attention to four stimuli in the precuing con- 
dition and eight stimuli in the postcuing con- 
dition, were not considered in the analysis of 
the experimental results. 

In the current study, before the digits were 
presented, the subject was shown a matrix of 
eight boxes corresponding to the placement of 
the digits. He was told that eight digits would 
be presented for a very brief time. After he 
saw the digits, his task was to point to each 
box on the response matrix and orally report 
the digit he had seen there. Guessing was en- 
couraged. 

Condition I consisted of the presentation of 
four cards with instructions to report all eight 
digits in any order. The presentation of each 
stimulus was preceded by 2 seconds with the 
oral signal “ready.” 

Condition II consisted of the 
eight cards with instructions to 
digits of only one of the rows. About 1.5 
seconds after the ready signal, the experimenter 


presentation of 
report the 
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orally cued the subject as to which row to re- 
port by saying “top” or “bottom,” and then 
immediately presented the stimuli. Half of the 
cards were preceded by each instruction, and 
the instructions were varied in a random 
fashion so that guessing the instruction was 
minimized. 

Condition III consisted of the presentation 
of eight cards with instructions to report the 
digits of only one of the rows. However, the 
cuing instruction was given about .5 second 
after the presentation of each stimulus. The 
stimulus was always preceded by the signal 
“ready.” 

Condition IV was the same as Condition I. 

The four conditions were always presented 
in the same order. Since practice effects do not 
increase digit span within a testing session 
(Sperling, 1960), it was felt that a balanced 
order of presentation of Conditions II and III 
was not essential. However, Conditions I and 
IV were compared in order to detect any prac- 
tice effects within the testing session. 

Every card was scored for the number of 
items reproduced in their correct positions. 
For each condition of each subject, a mean 
digit span was computed. The mean digit span 
is defined as the proportion of correct letters 
within a condition multiplied by the number 
of digits requested. Thus the proportion is 
multiplied by eight in Conditions I and IV, 
and by four in Conditions II and III. 


RESULTS 


In order to assess the combined ef- 
fects of (a) practice in reporting digits 
and (b) familiarity with the experimen- 
tal procedure, Conditions I and IV were 
compared. Bartlett’s test for homoge- 
neity of variance was not significant, so 
raw data were used. Table 2 shows the 
mean spans for the groups of subjects 


TABLE 2 


Mean Dicit Spans FOR Eacu Grour IN EACH 
CONDITION 


Reading group 


dition = 
Condi Disability Control 
I 1.37 2.61 
II 1.72 2.54 
II 1.24 1.80 
Iv 1.51 2.98 


Linna F. 
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in Conditions I and IV. There was no 
significant difference in mean digit span 
between the beginning (Condition I) 
and the end (Condition IV) of the test- 
ing session (F=1.14, df=1/36). This 
finding suggests that the confounded 
effects of practice and familiarity were 
insignificant. The results of Conditions 
II and ITI are also assumed to be free 
from influence by these effects. 

Decay of immediate memory traces 
is reflected in the comparison of 
pre- and postpresentation cuing instruc- 
tions. Because of the delay of instruc- 
tions as to which line of the stimulus 
matrix to report in the postcuing condi- 
tion (III), it was expected that the 
mean digit span would be lower in this 
condition that in the prepresentation 
cuing condition (IT). The extent of 
decay of immediate memory traces is 
reflected by the amount of difference 
between the two cuing conditions. The 
relationship between the prepresentation 
cuing instruction condition (TI) and the 
postpresentation cuing condition (TIT) 
for the groups of subjects was compared 
by means of an analysis of variance. 
Since Bartlett’s test for homogeneity 
of variance was not significant, raw 
data were used. Table 2 shows the mean 
digit spans for each group in Con- 
ditions IT and IIT. The reading control 
group showed a higher mean digit spa” 
than the disability group in both cu- 
ing conditions (F=7.84, df=1/18: 
p < .05). Prepresentations cuing instruc- 
tions yielded a higher mean digit spa” 
than did postpresentation cuing instruc- 
tions (F=34.75, df=1/37, p < 001): 
However, the difference between the 
experimental conditions was not greater 
for the reading disability group than for 
the control group, contrary to expecta- 
tions (F=1.12, df=1/18). : 

Of secondary interest in this study 
is the significant first order interactio” 
between pairs of subjects and group 
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of subjects, which was observed in both 
analyses of variance (Condition I ver- 
sus IV: F=4.90, df=18/37 p < .001; 
Condition II versus HI: F=5.10, 
ae p< 001). Since subjects 

ere individually paired on the basis of 
ett cae age, this interaction is 
fond due to age. Figure 1 presents the 
ae of mean digit span to chron- 
ie = age separately for each group 
oe "oa Each group was subdivided 
a age groupings, and lines were 
ia My the two sets of data by the 
Mirae of least squares. Reading dis- 
jeg a subjects of age 110 months 
om ee 8 months behind reading 
EN subjects in digit span, but dis- 
goer Py of age 140 months lagged 
Soniai 1 months behind the reading 
thes “a aa span. The trends suggest 
eR digit span increases with 
ps ogical age more rapidly for the 
ae group than for the reading dis- 

lity group, 

A 

DISCUSSION 


oa results of this study confirm 
items eh ay in that the number of 
cuing oe in the prepresentation 
numb Onditions was greater than the 

er of items available in the post- 


uo 


D 
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to chron- 


1. Relation of mean digit span 
d control 


1 age in reading disability an 
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presentation cuing instruction condi- 
tion. This implies that the same proc- 
esses were tapped in the current study 
as were tapped in Sperling’s study. 
Furthermore, the lowered memory span 
so often observed among cases of read- 
ing disability was also observed in the 
current study. 

The lack of difference between the 
groups of subjects in the number of 
items available in precuing and postcu- 
ing instruction conditions suggests that 
the immediate memory traces of reading 
disability cases do not decay at a faster 
rate than do those of normal readers. 
Rather, the underlying mechanism of 
the lowered digit span among reading 
disability cases must be sought in the 
other organism variables, mentioned pre- 
viously, which are related to immediate 
memory. For example, reading dis- 
ability cases may not pay attention to 
the entire stimulus field, and thus all 
of the elements of the stimulus will not 
reach the immediate memory processes. 
Another possibility is that reading dis- 
ability subjects, compared with normal 
readers, have a stricter limit on the 
amount of material which they are ca- 
pable of holding in the immediate mem- 
ory. A third possibility is that, since 
reading disability cases often display 
aphasoid characteristics (Bryant & Pat- 
terson, 1962), they also have difficulty 
in associating a given memory trace with 
the verbal response element which repre- 
sents this trace, and with responding 
with this verbal element. During the 
longer time required by them to make 
the association and response, the im- 
mediate memory trace may decay be- 
low the threshold of emission. Thus 
trace decay may play a role in the low- 
ered digit span of reading disability 
cases only because of the influence of 
response factors on it. 

The increase of digit span with an 
increase in chronological age was ex- 
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pected on the basis of studies previously 
mentioned. However, the greater rate 
of increase observed among the normal 
readers compared with the reading dis- 
ability cases was unforeseen. This dif- 
ference in rate of increase in span be- 
tween levels of reading ability can be 
interpreted in two ways. First, practice 
in reading may incidentally increase 
memory span by providing practice in 
perceiving and remembering large 
chunks of material. Since the effect is 
incidental, no gain in reading ability 
would be expected as a result of trans- 
fer from practice in tachistoscopic view- 
ing of a series of digits. This interpre- 
tation of the trends implies that pros- 
pective reading disability cases have the 
same span abilities as do prospective 
good readers, before reading instruction 
is given. A second interpretation of the 
divergent age trends is that the low span 
of reading disability cases is inherently 
associated with the substructure which 
underlies their reading difficulty. This 
interpretation implies that low memory 
span contributes to reading disability 
in that the child is unable to remember 
a sufficient number of stimulus elements 
to utilize them for reading. The view 
of lowered digit span of poor readers 
as a function of deficit in attentional, 
immediate memory, or response proc- 
esses is compatible with both interpre- 
tations of the divergent age trends. 


ALWITT 
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„FACTORS RELATED TO THE SHIFT OF PROFES- 
SIONAL ATTITUDES OF STUDENTS IN 
TEACHER EDUCATION 


LEON T. OFCHUS axp WILLIAM J. GNAGEY 


Illinois State Normal University 


The 71 college sophomore women enrolled in a teacher education curricu- 
lum were given the MTAI before and after a 1-semester course in child 
growth. Using the California F Scale and a personal rating form, 
inquiry was made into the correlates of attitude shifts during the 


course. 


though student perception of the instructor’s competence, 


permissiveness, and attitudes seemed not to be related to attitude shift, 
student ratings of their own parents were significantly associated with 
their perception of the instructor. A negative correlation (r = — .58) 
was found between the California F Scale and the MTAI. 


on of the effects of teachers’ 
ey sl their students has long 
foua varale, As early as 1934, Krall 
tended hat students’ social attitudes 
by ring shift toward the position held 
and fa teacher. Recently Della Piana 
tinshe (1955) found a positive rela- 
8S me p between a teacher’s attitudes 
wee by the Minnesota Teacher 
välte e Inventory (MTAI) and the 
čeni 4 re of his pupils. More re- 
Patin oyt and Cook (1959) found a 
ers ee between the teach- 
ings AT score and her pupils’ rat- 
of the whole school experience. 

explor Present study was designed to 
stude € some relationships between the 
nt-class-course-instructor complex 
each ees in student attitudes toward 
MTAL children as measured by the 


So 
ME 
E THEORETICAL CONSIDERATIONS 


Sige postulated that a college in- 
his st r may influence the attitudes of 
and oe without direct, forthright, 
tation cee efforts to do so. The desig- 
&Cture Of a particular text, the choice of 
ction and discussion topics, the se- 

of films: through all these the 


instructor reveals repeatedly his under- 
lying attitudes toward students and 
teaching. Even more potent could be the 
fact that a majority of the attitudes 
measured by the MTAI are expressed 
daily by the character of the instructor’s 
reaction to and interaction with his own 
students. 

If a student senses a sizable breach be- 
tween his own set of attitudes and his 
instructor’s manifest point of view, a 
state of dissonance may be produced in 
the psychic structure of that student 
(Festinger, 1957). After all, the college 
instructor is a person who can com- 
mandeer nearly all the sources of social 
power cited by French (1960). He is 
an expert; he possesses the power to 
reward and punish in a significant way; 
he has the legitimate right of the teacher 
to exert influence; and, if his MTAT 
score is high and valid, he may be an ex- 
tremely attractive individual in addi- 
tion. 

There are several ways that a student 
may attempt to reduce this dissonance: 
(a) he may leave the course, (b) he 
may shift his attitudes toward those of 
his instructor, (¢) he may perceive the 
instructor as an inferior teacher un- 
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worthy of emulation, (d) he may re- 
ject teaching itself as a long term career 
for him. As a consequence of this 
theorizing, we predicted the following 
relationships: 


1. Students who make large instruc- 
torward attitude shifts will perceive the 
instructor as more permissive, more ca- 
pable, and nearer to their own attitudinal 
position than will students who make 
minimal or opposite shifts. 

However, a student’s perception of 
his instructor may be distorted by some 
antecedent factors that could obliter- 
ate many of the pure effects of the 
instructor’s influence. One major dy- 
namic may be the sheer displacement 
of feelings for a parent on to the in- 
structor. As a result of these conjec- 
tures we predicted the following: 

2. Students who feel that their par- 
ents are either highly concerned about 
them or relatively uncritical of their 
behavior will perceive the instructor as 
significantly more permissive than will 
students who feel that their parents are 
lacking in concern for them or were 
highly critical of their behavior, 

Since the writers of the MTAI have 
used the characteristics of the “authori- 
tarian personality” (Adorno, Frenkel- 
Brunswik, Levinson, & Sanford, 1950) 
as a sort of operational definition of the 
“poor teacher” (Cook, Leeds, & Callis, 
1951), we predicted that: 

3. There will be a negative relation- 
ship between authoritarianism as meas- 
ured by the California F Scale and posi- 
tive attitudes toward children as meas- 
ured by the MTAT. 

Since rigidity of position has been 
strongly associated with authoritarian- 
ism (Adorno et al., 1950) we predicted 
that: 

4. Students who have highly authori- 
tarian personalities will make fewer high 
instructorward shifts than students who 
are low in the authoritarian factor, 


Leon T. Orcuus axb WILLIAM J. GNAGEY 


Logically, the picture of the “good 
teacher” inadvertently presented by an 
instructor with “high MTAI attitudes” 
should produce more dissonance in stu- 
dents whose attitudes score at the lower 
end of the MTAI that in those who 


score high. We subsequently predicted 
that: 


5. Students who have low final MTAI 
scores will less often plan to make a 
career of teaching than will students 
who have high final MTAT scores. 


RESEARCH DESIGN 
Subjects 


Seventy-one students at Illinois State Nor- 
mal University who were enrolled ina required 
course in two sections of child growth and 
development during the second semester of 
1961-62 served as subjects. With few excep- 
tions, the subjects were college sophomore 
women enrolled in either elementary education 
or special education curriculums, 

Both sections were taught by the same 
instructor who followed essentially the same 
instructional procedures in each, The MTA 
score of the instructor was 99, considerably 


above the average for his education an 
experience, 


Measurement of Variables 


At the beginning of the semester, the oral 
and the California F Scale were administere 
to all subjects, 

Toward the end of that semester, the MTAI 
was readministered along with a rating scale 
on which each student indicated, among other 
things, her perception of (a) the instructor’ 
permissiveness of disagreement with his op!"~ 
ion, (b) the instructor’s ability to explain 
material meaningfully, (c) the congruence 0 
her own and the instructor’s attitudes aoe 
children, (d) the criticalness of her own fathe 
and mother, and (e) the level of conce!? 
shown her by her own father and mother. t 

An additional question asked each sot 
to indicate whether or not she thought $ 
would be teaching 10 years from now. 


Scoring 


a ing 
The rating scales were scored by meas 
the number of millimeters between the 
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TABLE 1 


Ca z 
I sann COMPARISON OF Instructor Ratincs BY Stupents WHO Mane HiIcm 
NSTRUCTORWARD MTAI SHIFTS witH THoseE BY STUDENTS WHO MADE 
MINIMAL or Opposite SHIFTS 


Instructor permissiveness 


Instructor competence 


_Congruence with 
instructor attitude 


` 


Shift Above Below Above Beli 
$ 0 Abovi bi 
median median x? ? moin imin x p ie aoe x p 
Hi 
ma 19 15 20 14 19 15 
12 19 1.92 .08 13 19 30 25 13 19 154 13 


t ‘ 
of ihe ment of the scale and the farthest edge 
were ee Ject’s vertical mark. Attitude shifts 
direction of the a noting the magnitude and 
aans MTAI ee post differences in a stu- 
dine ree career question was scored 
Scale (ise ty no, while both the California F 
the MTAI to measure authoritarianism) and 
ard pri were scored according to the stand- 
Ocedure indicated in each manual. 
e chi square median test was used in 


n 
early every analysis. 


RESULTS 
Hypothesis 1 


ma readily be seen in Table 1, no 
Ween iy differences were found be- 
ratings € high shifters’ and low shifters’ 
structs of instructor permissiveness, in- 
instru ; competence, or in the student- 
Ward ant congruence of attitudes to- 

e children, We were unable to reject 

null hypothesis in any of these cases. 


si 


Hypothesis 2 

When students who rated the intruc- 
tor as highly permissive of disagreement 
were compared with students who rated 
him low in permissiveness, several rela- 
tionships emerged suggesting antecedent 
forces. 

1. Table 3 shows that students who 
rated their mothers as relatively uncrit- 
ical of them perceived their instructor 
to be significantly more permissive than 
did students who rated their mothers 
as relatively supercritical of them 
(x2=5.07, df=1, p < .025). Table 2 
indicates that the same was true for a 
similar rating of their fathers (y*=4.14, 
df=1, p < .025). 

Parenthetically, a contingency coeffi- 
cient of correlation was computed be- 
tween the students’ ratings of the criti- 
calness of their mothers and their 
fathers. A sizable positive relationship 


TABLE 2 


Cy 
I 
Sovare Comparisons of FATHER RATINGS BY STUDENTS 


ERMISSIVENESS WITH THOSE BY STUDENTS 


Wao RATED THE Instructor HICH 
Wuo Ratep Him Low IN PERMISSIVENESS 


Concern of father 


Criticalness of father 
I 
Derme ctor Above Below Above Below : 
Ssiveness median median x $ median median x $ 
High 
20 16 16 
oi x 13 4.14 025 17 17 0 100 
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TABLE 3 


CHI SQUARE COMPARISONS OF MOTHER RATINGS BY STUDENTS Wuo RATED THE INSTRUCTORS H'GH 
IN PERMISSIVENESS WITH THOsE BY STUDENTS WHo Ratep Him Low IN PERMISSIVENESS 


Criticalness of mother 


Concern of mother 


Instructor Above Below » Above Below : 
permissiveness median median 7 p median median x p 
High 11 20 23 ji P 
Low 21 12 3.07 025 12 24 8.24 005 


was found (C=.39). This relationship 
was significant at better than the .001 
level of confidence (y?=12.82, df=1). 

2. Table 3 reveals that students who 
rated their mothers as being highly con- 
cerned about their well-being perceived 
the instructor to be significantly more 
permissive than students who rated 
their mothers as relatively low in con- 
cern for them (x*=8.24, df=1, 
p < .005). However, Table 2 shows 
that this relationship did not hold for 
ratings of their fathers. 


Hypothesis 3 


When a product-moment correlation 
coefficient was computed between the 
scores on the California F Scale and 
the MTAI scores for the 71 students, 
a sizable negative relationship was found 
(r= —.58). This relationship was sig- 
nificant at better than the .01 level of 
confidence (=6.0, df=70). 


Hypothesis 4 


No significant difference in authori- 
tarianism (as measured by the Cali- 
fornia F Scale) was found between high 
shifters and low shifters. r 


Hypothesis 5 


Table 4 shows that students who made 
low final MTAI scores planned signifi- 
cantly less often to be teaching in 10 
years than did students who made high 
final MTAI scores (x?=3.16, df=1) 
b < .04). When the initial MTAI 
scores of the same two groups were com- 
pared, no significant difference was 4P~ 
parent (x*=.09, df=1, p > .70). 


CONCLUSIONS AND DISCUSSION 


Under the conditions of this study, 
neither the students’ authoritarianism, 
nor their perception of their instruc- 
tor’s competence, permissiveness, 2 


TABLE 4 


Crt SQUARE Comparison or MTAI SCORES or STUDENTS Wuo P 
10 Years AND STUDENTS WHo Do Nor 


LAN TO BE TEACHING IN 


Initial MTAI scores 


Plan to be Final MTAI scores 
teaching in ji ; 
10 years? are RaR ü Above Below ? 
? media x p median median xê 
Ves 21 at 25 16 
No 13 15 09 > 70 11 is 461 2 04 
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agreement with their own attitudes 
toward children were associated with a 
change in the students’ professional at- 
titudes as measured by the MTAI. It 
1s possible that students encountered 
ica in other courses taken con- 
etd with child development that 
x any tendency to shift 
— the child centered attitudes of 

experimental instructor. It is also 
os that their perception of the in- 
ne ang was distorted by some ante- 

variables. 
au finding of this study was 
Hr ips suggesting a tendency for 
thats ate transfer on to the instructor 
ri pi about a mother-father au- 
tion a gure. It may be that percep- 
iinet an instructor was so strongly a 
man a of this phenomenon that his 
aR T classroom behavior was irrele- 
R o attitude change. 

E A predicted, it appears that stu- 
e ho high authoritarian tendencies 
attitude ave very few warm, accepting 

À S toward children. 
we, eons students who came up 
titer Ei final MTAI scores were the 
nti who planned to be teaching in 10 
S. The dissonance caused by stu- 


dents’ low initial scores and the instruc- 
tor’s child-centered philosophy may 
have been reduced by some students by 
rejecting teaching instead of by shifting 
toward the instructor’s attitudinal posi- 
tion. 
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STRATEGY SELECTION AND NEGATIVE 
INSTANCES IN CONCEPT LEARNING? 


LOY S. 


BRALEY 


University of California, Santa Barbara 


Exclusion solutions were investigated by requiring Ss to utilize informa- 
tion from negative (nonreinforced) instances in a concept learning task. 
Of 70 exclusion condition Ss only 3 adopted an exclusion strategy. 
Task performance was unrelated to conditions of reinforcement, instruc- 


tion, and type of concept. Failu 


re to use negative information was 


related to fundamental information handling strategies such that limited 
memory storage induces trial-and-error search based on positive identi- 
fication of reinforced instances with complex stimulus arrays. A reduc- 


tion of the cue space should favor use of strate; 


storage of what is not correct. 


gies based on memory 


Recent and current interest in com- 
puter simulation of problem solving 
and concept learning, as well as the 
burgeoning area of programed instruc- 
tion, have given increased impetus to a 
more systematic analysis of problem 
solving processes, The fidelity of any 
simulation rests, of course, on knowl- 
edge of how human subjects do in fact 
go about solving problems, although 
contributions to understanding occur 
reciprocally. The present investigation 
concerns one of the boundary problems 
in the area, viz., discounting storage 
and speed advantages of computers, are 
there problem solving strategies or in- 
formation processing procedures that 
could readily be built into machines 
but which have only a tenuous analog 
in human strategy selection? One area 
where this may well be the case is that 
of the processing of negative informa- 
tion, where negative information refers 
to information as to what is not correct 
with regard to a given problem situa- 
tion. Mention has been made, and some 
evidence presented (Bruner, Goodnow, 
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& Austin, 1956; Donaldson, 1959; 
Hovland & Weiss, 1953) to snggest that 
human subjects are apparently either 
unwilling or unable to effectively utilize 
negative information under conditions 
where its informational value, as far aR 
problem solving is concerned, is equiva- 
lent to positive information. If this 15 
so, there are very practical implications 
for education as well as for the under- 
standing of the learning process and its 
simulation. 

The problem solving behavior that 
was the focus of this investigation W35 
that of concept learning where negative 
information was represented by negative 
instances of the concept to be learned. 
As far back as 1933 Smoke had gon- 
cluded that negative instances contrib- 
uted little to concept learning. Moré 
recently Hovland and Weiss (1953) 
Friebergs and Tulving (1961), an 
Cahill and Hovland (1960) were able 
to demonstrate that concept learning 
though difficult, was possible with neg” 
tive instances, but apparently Or y 
when the subjects are provided with # 
complete specification of the populatio”® 
of cues (number and value of releva” 
dimensions) prior to solution attempts: 
The question of the ability or willing- 

154 


Concept LEARNING 155 


ness of the subjects to utilize negative 
information under the usual concept 
learning conditions has not been ade- 
quately explored. 

There are two related, but separable, 
— of the concept learning process 
that require mention. The first of these 
fr the discrimination of relevant cues 
a some larger space of cues, upon 
S ich final problem solution rests. 
en the discriminations that occur 
pe on the strategy employed to 
tian and test cue information, In 
tin, co the use of negative infor- 
tise of actually refers to the subject's 
the: tig an exclusion strategy rather than 
clusion, = negative cues per se. Ex- 
matics S ke are familiar in mathe- 
proceed a proof sometimes must 

sce y the exclusion of other mem- 
rather a given set that are not true, 
what i han by positive identification of 
dures 5 true. Trouble shooting proce- 
attem urnish another example of where 
the Rar at positive identification of 
far E of malfunctioning is frequently 
Ra efficient than proceeding by the 
malfu on of intact subsystems until the 
by rile subsystem is identified 
tinctio usion. One of the principal dis- 
Dads hee strategies based on 
on nt identification and those based 
Bich wee is that the latter require 
whil greater use of memory processes 
€ the former are more in the nature 
trial and error. 
Saita nee of three experiments was 

a to explore the acquisition and 
uneti ion of negative information as & 
con N of certain types of concepts, 

ltions of instruction, and conditions 
s ugi forcement, The procedure in all 
tion es entailed simultaneous presenta- 
On thse a positive and negative instance 

a ach trial, Conventionally in such 
the H each positive is an exemplar of 

egat t to be learned, while the 

e instance has one or more 


critical dimensions of the concept absent 
with no consistent defining attribute 
except the absence of the correct con- 
cept. This need not be the case how- 
ever, since it is a simple matter to em- 
ploy two concepts with reinforcement 
defining the one to be learned. In this 
case the nonreinforced concept would 
then be represented by the “negative” 
instances. The subject could meet cri- 
terion either by learning the reinforced 
concept or learning the nonreinforced 
concept and choosing the opposite in- 
stance on each trial. In addition, the 
handling of negative information when 
only a single concept is present can be 
investigated by a procedure which rein- 
forces as correct the subject’s choice of 
those instances devoid of any consistent 
defining property. Both of these are 
referred to as exclusion solutions (or 
strategies)—that is, where the subject 
meets criterion by learning a concept 
represented by the negative instances 
and then chooses the opposite instance 
on each trial. To be consistent with 
current terminology (vide Kendler, 
1961) exclusion solutions can be classi- 
fed according to the type of concept 
employed in the negative instances. The 
conventional types would then be: con- 
junctive-exclusion, relational-exclusion, 
or disjunctive-exclusion solutions. In 
general, conjunctive concepts are those 
where each of the positive instances 
has the defining property or properties, 
while in disjunctive concepts the posi- 
tive instances have one or the other of 
the defining properties, so at least two 
instances are necessary to define the 
concept. Relational concepts do not 
have any specific stimuli in common 
but rather the attributes on the positive 
instances have a common set of rela- 


tionships. 
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EXPERIMENT I 


The first experiment was designed to 
investigate use of negative information 
in a task involving simultaneous pres- 
entation of an exemplar of each of two 
concepts on each trial. The subject 
could therefore meet criterion either by 
learning the reinforced concept or by 
learning the concept represented by the 
negative instances and then choosing 
the opposite instance. The information 
available on any trial is equivalent for 
either procedure. However; where the 
reinforced concept is the more difficult, 
greater efficiency could be achieved by 
learning the easier concept represented 
in the negative instances and then, by 
exclusion, choosing the one that is rein- 
forced as correct; a very obvious pro- 
cedure for a machine. To evaluate the 
possible contribution of set-to-solution 
attempts, instructions were manipulated 
to induce either a concept attainment 
or a general problem solving orientation. 


Subjects 


The subjects were 40 high school students 
participating in a university level 
of summer instruction, 22 of whom were 
females. All the subjects were volunteers and 
were randomly assigned to the four experi- 
mental conditions. 


program 


Design and Procedure 


The two conditions of instructions and the 
two types of concepts formed a 2x2 factorial 
design with 10 subjects per cell. On each trial 
all subjects were exposed to the simultaneous 
presentation of two 4X6 cards presented in 
adjacent windows of a large black plywood 
screen. A subject indicated his choice by de- 
pressing one of two keys affixed to the table 
immediately below the exposure windows, 
Upon a correct choice, reinforcement was 
delivered immediately by a light located at the 
upper rim of the exposure windows. Twelve 
successive correct responses were necessary to 
meet criterion. 

Each of the two cards presented on any one 
trial contained two small geometric figures 
inside a larger geometric figure. The three 
figures on any card were combinations of cir- 


cles, squares, and triangles, each of which could 
be red, blue, green, or yellow. One of the cards 
on each trial was an exemplar of a relational 
concept, and the other that of a disjunctive 
concept. Defining properties of the former 
were two similarly colored geometric figures 
within a differently colored larger geometric 
figure. The disjunctive concept was defined 
by two diffcrently colored geometric figures or 
two similarly colored figures within a larger 
figure of the same color. On the basis of 
choice behavior alone it was not possible to 
determine if an exclusion solution had been 
employed and so an interrogation procedure 
was developed and administered after a subject 
had completed the task. 


Instructions 


In the critical segment of the instructions 
half of the subjects were instructed to: 


discover what it is that makes 3. card cor- 
rect, that is, find those characteristics of the 
cards that you need to pay attention to 50 
as to be able to select the correct card ou 
cach trial [concept attainment instructions]. 


To avoid indicating that there were specific 


correct cards, the problem solving oriented 
instructions were: 


make a choice each time the two cards ap- 
pear and the light [reinforcing stimulus] will 
tell you whether or not you are correct. 
In this way you will discover what it 15 
that you need to pay attention to so as to 
reach a point where you can turn on the 
light on each trial, 


Results 


Table I presents the means and 
standard deviations for the four groups 


TABLE 1 


TRIALS TO CRITERION AND STANDARD DEVIATIONS 
FOR RELATIONAL AND Disyuncrtive CONCEPT 
LEARNING IN EXPERIMENT I 


Type of concept 
ee aa E 7 


Instructions Relational Dirion i. 
M SD M SD 

Concept 

attainment 149 10.5 30.3 16.1 

Problem 

solving 17.5 121 30.6 173 
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showing clearly that the relational con- 
cept is easier to learn. Analysis of vari- 
ance (F = 5.37, df = 1/36) on square 
root transformed trials to criterion 
yielded significance only for the type 
of concept. Analysis of the protocols 
indicated that despite the greater ease 
of attainment of the relatioñal concept 
not a single subject made use of a rela- 
tional-exclusion solution to meet crite- 
at when reinforced for choice of the 
— concept. This failure to 

Onomize in information handling sug- 
gests that the subjects proceeded by 
N identification of what was cor- 
i. that attention was directed 
pa y oA those cards that were rein- 
a a l consequently the information 
p le`in the negative instances was 

her ignored or overlooked. 


EXPERIMENT II 


Mie experiment was designed to in- 
decile assurance that the absence of 
ing oe S solutions was not a shortcom- 
mote i e subject’s report and to test 
jects Ta irectly the ability of the sub- 
ton ‘ig make use of negative informa- 
Wien the form of exclusion strategies 
the te was delivered for 
Sinita of instances that had no 
cept — defining property and a con- 
no as present only in the negative 
nreinforced) instances. 


Sub H 
Jects 

were drawn 
Experiment b 
enly dis- 


ee Gog for this experiment 

ixteen same population as in 

Gib and 24 females were ev! 
among the four conditions. 


Procedy io 


stant details of procedure and design were 
ion of to Experiment I, including manipula- 
Ment h instructions. However, in this experi- 
Conjun, alf of the subjects were reinforced ona 
those ictive concept and the remaining half on 
ining instances devoid of any consistent de- 
cedure attribute, such that an exclusion pro- 

e c vas the only possible mode of solution. 

conjunctive concept was that of a small 


lue ty 
© triangle. The dimensions of the instances 


were three values of figure (triangle, square, 
and diamond), four of color (red, blue, green, 
and yellow), and two of size (large, small). 


Results 

Means for learning the conjunctive 
concept were 37.9 and 33.3 (SDs= 
18.2., 17.8, respectively), with the prob- 
lem solving instructional condition 
somewhat, but not significantly, easier. 
For those subjects where criterion could 
only be achieved through use of a con- 
junctive-exclusion solution, not a single 
subject was able to do so. However, in 
view of the possibly low termination of 
trials (60 trials) an additional 10 sub- 
jects were run for 140 trials on the 
exclusion procedure, 5 under each in- 
structional condition. Only 1 of these 
10 reached criterion and then could 
not verbalize his basis of choice. With 
only 1 subject out of 30 able to reach 
criterion, statistical analysis of these 
data appeared unnecessary. 

Whereas the first experiment indicated 
failure to utilize negative information 
efficiently, this one demonstrated that 
problem solving occurs very infre- 
quently when positively reinforced in- 
stances are devoid of any consistent 
defining attribute and an exclusion solu- 
tion is the only one possible. There is, 
however, a possible source of contami- 
nation in Experiment II, depending on 
whether reinforcement operates sym- 
metrically or asymmetrically. If the rein- 
forcing stimulus differentially controls 
the attention of the subject to positive 
or negative instances, then the failure 
of exclusion strategies to emerge in Ex- 
periment IT may be attributed to con- 
ditions of reinforcement rather than to 
a more general inability to utilize in- 
formation from negative instances. Ex- 
periment III was designed to investigate 
this possibility. 

Experment II 


Procedure and Sub jects 


This experiment was a partial replication of 
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the second. The instructional variable was 
eliminated in light of the insignificant rela- 
tionship to differential performance. Half of 
the subjects was reinforced on the conjunctive 
concept and the remaining half on those in- 
stances devoid of any consistent defining at- 
tribute, as in Experiment II. However, for 
half of each of these two groups reinforcement 
was delivered for a choice of the correct in- 
stance. For the other half of both groups the 
occurrence of the reinforcing stimulus signaled 
to the subject that he had made an incorrect 
choice and no light signaled that the correct 
choice had been made. 

The 2 X 2 design again had four cells with 
10 subjects per cell. The 40 subjects were 
volunteer undergraduates, 33 of “whom were 
female. Stimulus materials were the same as 
in Experiment II and all subjects were given 
the problem solving instructions. The cri- 
terion remained the same for learning, but 
training was discontinued at 90 trials, instead 
of 60, if the subject had not met criterion. 


Results 


Learning of the conjunctive concept 
proceeded much as in Experiment II for 
the problem solving instructional con- 
dition (Ms = 31.0, 27.3; SDs = 17.2, 
16.9). Of the 20 exclusion condition 
subjects only two met criterion—in 70 
and 77 trials. Both of these subjects 
were in the condition where the rein- 
forcing stimulus was delivered for a 
correct choice. These results constitute 
a replication of Experiment II, and 
indicate that reinforcement operated 
symmetrically under the conditions 
employed, 


Discusston 


In the kind of problem solving be- 
havior investigated here the evidence is 
substantial of a gross inability to handle 
negative information. Neither condi- 
tions of reinforcement nor type of con- 
cept employed had any appreciable 
effect on such information handling. 
Instructions, manipulated so as to in- 
crease the flexibility with which a sub- 
ject structured the task, similarly had no 
discernible impact on frequency of ex- 


clusion solutions. In addition to the 
implications of these results for concept 
learning generally, and for computer 
simulation of human problem solving 
processes in particular, an attempt will 
be made to suggest why exclusion solu- 
tions are so infrequent and under what 
circumstantes they are likely to be used. 

First, as mentioned earlier there are 
two somewhat different, but contingent, 
processes involved in the type of con- 
cept learning investigated here. One is 
the actual discrimination of the relevant 
cue(s) necessary for concent identifica- 
tion, while a second is the strategy em- 
ployed in searching out and testing cue 
information. The essence of a strategy 
is that it is a knowledge process that 
when once learned can be used in a 
variety of problem situations. The basic 
cue discrimination is limited only to the: 
specific problem. In the present inves- 
tigation, with the exception of the trans- 
formation (choice of opposite instance), 
the same basic cue discrimination was 
required for both exclusion and control 
subjects, while the strategies of informa- 
tion handling were different, Conse- 
quently it was not the discrimination 
itself that made for difficulty in learn- 
ing, but rather that the exclusion con- 
dition required a problem solving ap- 
proach that has very low strength in 
most response repertoires, In addition, 
studies of reversal learning (Buss, 1956; 
Kendler & D’Amato, 1955) have demon- 
strated that subjects can perform in 
terms of an exclusion solution once they 
have learned the now-to-be excluded cuc 
as a positive instance. This again sug- 
gests that the difficulty must lie in the 
cue search strategy employed in the ac- 
quisition phase. 

In the present task the subject pro- 
ceeded by discriminating some cue and 
testing its appropriateness by pressing 4 
lever. If he was not positively reinforced 
he could simply discard that cue and 
resample, as Bruner et al. (1956) found 
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many of their subjects did, or store the 
cue as an instance of what the concept 
was not. The difference would be be- 
tween an almost blind trial-and-error 
strategy and a memory strategy that, 
by remembering what is incorrect, could 
progressively narrow the relevant space 
of cues. However, where the stimulus 
array is complex with a fairly large 
Space of possible cues then an attempt 
i. PEY storage of negative instances 
S ikely to be inefficient, if not impos- 
e (Analogous to the haystack 
o trying to remember each piece 
iS rs under which the needle is not.) 
ta portent variable then, controlling 
plo bse strategy that will be em- 
ten es ould be the subject’s percep- 
tenet the task as embodying a cue 
When Hal his memory capacity. 
i Piss with a complex stimulus 
hom: subjects adopt a strategy of 
a bee by an almost blind trial-and- 
a tategy of positive identification 
ony as to what the concept is) with 
ree TORA activation of memory 
his we However, a memory strategy 
Hawa a subject to remember in- 
von ee what the concept is not 1s 
eae ikely to be used where a subject 
en ves the potential cue space to be 
ale ör where the properties of this 
a are specified for him by the 
ictal as Hovland and Weiss 
s a have done, Campbell (1960) 
Work ecently proposed within a “frame- 
nha the comparative psychology of 
and. i ge processes, & blind-variation- 
a selective-retention process as funda- 
ntal to all inductive achievements.” 
a Present analysis makes a similar as- 
die ption, such that the two strategies 
a ve are problem solving heuristics that 
e likely “inductive achievements” in 
€ human organisms’ learning history- 
a Pah of exclusion solutions then be 
Problem 2, seanda E PD e 

of the 1, solving strategy, a7 REAN 
he load it puts on memory processes 


it is likely to have a low probability of 
evocation. Only under the restricted 
conditions suggested above are exclusion 
solutions likely to occur. However, once 
a tentative positive identification of the 
relevant cue space has occurred then 
negative instances can be used to in- 
crease the precision of the defining at- 
tributes of the concept. In complex 
tasks negative instances serve principally 
to signal, when an error occurs, that the 
subject’s current cue discrimination is 
incorrect or incomplete and are not likely 
to be used’ as direct sources of informa- 
tion until some reasonably well-defined 
positive representation of the solution 


has been acquired. 
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The quads attained the concepts initially in significantly less time than 


cepts initially. Subsequently, 


16 from the quads, 16 from the pairs, and 


16 individuals attained a transfer concept after a delay of about 30 sec.; 
an equal number attained a transfer concept after a delay of 12 min. 
The quads attained the concepts initially in significantly less time than 


the pairs and the individuals ; however, 


individuals performed’ significantly 


those who learned initially as 


better on the transfer problem tkan 


those who learned in pairs and quads, 


——<—S ss 


How efficiently persons attain con- 
cepts and other outcomes in the cogni- 
tive domain when working as individu- 
als, in comparison with working in 
groups, is of significance in schools as 
in other behavioral settings (Klaus- 
meier, 1961), According to Lorge, 
Fox, Davitz, and Brenner (1958), the 
considerable experimentation on the 
quality of group and of individual per- 
formance had not yet produced conclu- 
sive results. Later, Fox and Lorge 
(1962) reported that the quality of 
decisions of groups was equal to that of 
individuals when the time for group 
activity was increased from 50 to 100 
minutes; however, when only 50 minutes 
of time were available, the individuals 
performed significantly better than the 
groups. Duncan (1959) concluded in 
his survey of problem solving perform- 
ances that the more efficient individu- 
als usually perform better than the 
mean performance of groups. In a simple 
type of problem situation involving 


1 The research reported herein was supported 
initially by the Research Committee of the 
Graduate School of the University of Wiscon- 
sin and later in accordance with a contract 
between the University of Wisconsin and the 
United States Office of Education, Department 
of Health, Education, and Welfare. 


anagrams, Anderson (1961) reported 
that groups of three achieved higher 
than groups of two, and groups of two 
higher than individuals, Anderson also 
reported that the large majority of ex- 
periments showed group performances 
to be superior to performances of 
individuals. 

Though the results are yet inconclu- 
sive concerning performances of indi- 
viduals and groups of varying size 10 
initial learning situations, it is surprising 
that social psychologists and others have 
not yet attempted to determine the 
effects of initial learning as an indi- 
vidual or a member of a group upon 
Subsequent performance when working 
alone. A possible contributing factor tO 
this lack of experimentation is the rela- 
tively large number of subjects in- 
volved, the difficulty of scheduling, and 
other practical matters. 

Though the problems of experimenta- 
tion with groups are considerable, it ÍS 
important to attempt to secure answers, 
for in education, government, and in- 
dustry, committees and other forms of 
group activity are widespread. In many 
classrooms, also, small group activities 
are used widely in order to achieve 
outcomes in the affective domain, such 
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as attitudes and values, which can be 
attained best in small groups. Small 
oe are also arranged in order to 
ee concepts, solve problems in 
Fs bli had and science, and achieve 
eS outcomes in the cognitive domain. 
a at no consistent explanations 
cane coming concerning why persons 
wae i groups, in comparison with 
be as individuals, are more or less 
a on the same type of tasks. 
ie experiment now reported, the 
iioa were to ascertain whether 
eral oo acquired concepts 
fe w e ciently when initially work- 
‘erage Oscar: in pairs, and in 
fen ae our, and to ascertain whether 
tinier ormed equally well on an 
silat e and a delay transfer problem 
working as individuals. 


PROCEDURE 
Subjects 


Pied os twenty-eight subjects were 
Psycholog. omly from classes in educational 
Semesters ey two blocks of 64 during two 
the ee hey were told that participation 
Course are was a requirement of the 
reported p. that the main results would be 
Semester. ack to them toward the end of the 
- All the subjects were in the age 


range É 
Was oe 21-25; the median and modal age 


Erber; 
Yperimental Material 


A 
It ee oe ordered figural board was used. 
each of signed so that each card contained 
fining EREN attributes and one of two de- 
Poratin aracteristics, the total display incor- 
Stic in the attributes and defining character- 
attribut all possible combinations thus: Seven 
rders o amber of borders, continuity © 
ture of number of figures, size of figures, tex- 
Ures figures, color of figures, shape of fig- 
Itig ate their respective defining character- 
Smal) Ne OF two, solid or broken, one or two, 
Or large, solid or spotted, red oF green, 
we ellipse. 
beddeq hundred twenty-eight concepts 
by the on this display board can be defi 
information on each card singly, €g» 


Circle 
em- 
ned 


one solid border with one small solid red 
circle, two broken borders with two large 
spotted green ellipses. One single concept can 
be defined by the information on all 128 cards 
—one or two, broken or solid borders with one 
or two, small or large, solid or spotted, red or 
green, circles or ellipses. A large number of 
concepts can be defined by combining one or 
more of the seven attributes with one or two 
of the defining characteristics. 

In this experiment, the concepts to be at- 
tained had two relevant attributes in combina- 
tion with one or more defining characteristics, 
e.g., broken borders with circular figures, two 
bordered small figures, solid red figures, one 
large figure, etc. There are 84 of these con- 
cepts of two relevant attributes contained on 
the 128-card board, and for each there are 
32 positive instances, or exemplars, and 96 
negative instances. Stated differently, each 
concept of two relevant attributes serves to 
categorize all 128 cards into two groups, one 
group of 32 exemplars of the concept and 
another group of 96 nonexemplars; the latter 
are all exemplars of the concept which can be 
defined by the five nonrelevant attributes. 
The 128 cards have been placed on the board 
in an ordered array of 8 rows and 16 columns. 

The four concepts to be attained in the 
tial learning situation by each individual, 
pair, and quad were as follows: broken bor- 
ders, circular figures; two borders, small fig- 
ures; solid red figures; and one large figure. 
The concept used in the transfer problem was 
one-border elliptical figures. 


ini 


Experimental Procedure 


Table 1 shows the design of the experiment. 
Assignment to the three treatment groups was 
random. Thirty-two subjects participated as 
individuals in the initial learning situation; 
subsequently 16 of these engaged in the trans- 
fer problem immediately, and 16 others after 
a 12-minute delay during which they read an 


TABLE 1 


DISTRIBUTION OF SUBJECTS BY TREATMENT 
Groups UNDER INITIAL LEARNING AND 
TRANSFER CONDITIONS 


Initial Immediate Delay 


Treatment 

group learning transfer transfer 
Individual 32 16 16 
Pair 32 16 16 
Quad 64 16 16 
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article. Thirty-two participated initially as 
members of pairs; subsequently, 16 of these 
participated immediately in the transfer prob- 
lem, and 16 others after a 12-minute delay. 
Sixty-four subjects participated initially as 
members of 16 quads; subsequently 16 of 
these engaged in the transfer problem immedi- 
ately, and 16 others after a 12-minute delay. 
The 32 subjects from the quads who did not 
participate in the transfer phase were elimi- 
nated randomly. Similarly, all subjects were 
assigned randomly to the immediate and delay 
transfer problems. 

In the initial learning situation, four con- 
cepts in sequence were attained by the subjects 
as individuals in pairs, or in quads. A 4X 4 
Latin square design was used in assigning 
each of the 4 sequences of concepts to the 
individuals, pairs, and quads. Each subject, 
whether having learning initially as an indi- 
vidual, in a pair, or in a quad, worked the 
same transfer problem, 

The subjects appeared at the Learning 
Laboratory and, after a brief introduction 
with the experimenter, received the following 
instructions: 


This experiment is concerned with how 
people attain concepts. You are going to 
have an opportunity to attain several con- 
cepts. You will be shown a display of cards 
with various borders, figures, and colors, 
[The subject was then shown a 32-card dis- 
play board. The two defining character- 
istics of each attribute were pointed out, 
ie, one or two figures, large or small fig- 
ures, solid or textured figures, red or green 
figures, and circular or elliptical figures.] 
Notice that each card is different. There 
are, however, a number of ways that the 
cards may be grouped so that they possess 
some common feature or features. For ex- 
ample, all cards with circular figures could 
be grouped together. Can you show me 
what cards on this display board would 
belong to such a group? [The experimenter 
waited until the subject had pointed out all 
the cards that had circular figures.] That 
is very good. We might also group together 
all the cards with red elliptical figures on 
them. Can you show me which cards 
would belong to this group? [Again the 
experimenter made sure the subject found 
all positive instances.] O.K., that is fine. 

When I said all red elliptical figures could 
be grouped together, I was stating a rule 
or a concept for classifying the display. 
In this experiment, your job will be to find 
out what rule I have used for grouping a 
series of similar cards. 


The procedure is as follows. At the begin- 
ning I will show you one card which is a 
member of the concept to be attained. Then 
you are to select other cards which you 
want to test as belonging to the same con- 
cept. You may select a card for testing by 
reading off the number you sce right below 
it. Each time you test a card, I will tell you 
if it is a member of the concept. As you 
find out what cards do and do not belong 
to the concept, you can determine the con- 
cept. Whenever you think you know it, 
you may stop, and check it here. We use 
this form for this purpose. [The experi- 
menter then showed the subject how to fill 
out a checkoff slip.] If the concept is col 
rect, the problem is over. 3f it is not I will 
simply say “not correct,” and you will con- 
tinue testing cards until you again feel you 
know what the concept is. You may offer 
as many concepts as you like. The job, 
however, is to get the concept as quickly 
as possible. 

Do you have any questions? 


The instructions were. read to the indi- 
viduals, pairs, and quads. To each pair an 
quad the additional instructions were given 
that they should talk freely with one another 
while attaining the concepts and that an 
subject could offer a card choice or a concep 
No other instructions were given and no leader 
or spokesman for any pair or quad wa 
designated. ; 

Upon receiving the instructions, the subjects 
worked at the task according to the Thre 
treatment groups. The subjects who did a 
engage in the immediate transfer problem le 
the laboratory and were instructed to ages 
an article. After 12 minutes they wer 
brought back to the laboratory for the dlelly 
transfer problem. The four initial concep 
and the immediate and delay concepts Wie 
attained in a period of 30-60 minutes, 
pending upon the efficiency of the subject- 


RESULTS 


transfer, and delay transfer. b 
same reason, 32 of the 64 subjects W 
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TABLE 2 


Mean TIME TO CRITERION IN MINUTES FOR 
INITIAL LEARNING AND TRANSFER 
ACCORDING TO TREATMENT GROUP 


Treatment Initial Immediate Delay 
group learning transfer transfer 

Individuals 4.62 2.34 3.40 

Ouai 4 3.89 4.82 3.57 
ees 3.27 4.62 4.01 


cape initially as members of quads 
cre eliminated randomly from partici- 
pation in the transfer part of the ex- 
periment. 
aae mean time to attain the four 
fhidtyit s oe was computed for each 
total e hen and quad, yielding a 
leitar 48 scores, 16 for individuals, 
the im pairs, and 16 for quads. In both 
aa te and in the delay transfer 

Reed i _ there were 16 who had 
Bet initially as individuals, 16 in 

T and 16 in quads. 

; r ubi 2 are given the mean scores. 
efficien. be observed, the rank order in 
ing w cy of performance in initial learn- 
(3.80), quads (3.27 minutes), pairs 
ever, ; and individuals (4.62). How- 
lects wn, immediate transfer, the sub- 
Were o learned initially as individuals 
A oo. efficient (2.34), with time 
jects aly about half that of the sub- 
but let now worked as individuals 

earned initially in pairs (4.82) 
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and quads (4.62). In delay transfer 
the rank order of efficiency was indi- 
viduals, pairs, and quads, but the differ- 
ences were not so large as for immediate 
transfer. 

Three one-way analyses of variance 
were computed on initial learning scores, 
immediate transfer, and delay transfer. 

The F ratio shown in Table 3 for 
initial learning indicates that the differ- 
ence among the three treatment groups 
was significant beyond the .01 level. 
Subsequent T tests of the initial learn- 
ing scores between treatment groups 
showed the pairs to be significantly 
better than the individuals at the .10 
level, the quads better than the pairs 
at the .10 level, and the quads more 
efficient than the individuals at the .01 
level. 

For immediate transfer, the difference 
among treatment groups was significant 
beyond the .05 level. T tests between 
sets of means showed that the subjects 
who had learned as individuals were 
significantly more efficient than those 
who had learned in pairs or in quads 
at the .05 and .01 levels, respectively. 
Although in the same relative rank or- 
der, the difference among treatment 


groups was not significant for the delay 


transfer condition. 


Discussion 
An important methodological contri- 


bution of this experiment is the design 


TABLE 3 


Res 
SULTS 
LTS or Tren One-Way ANALYSES OF V 


J ARIA 
ONDITIONS BY GROUP SIZE 


NCE ON TIME TO CRITERION FOR INITIAL 


a LEARNING AND TRANSFER C 
Source Initial learning Immediate transfer Delay transfer 
df MS F aj MS F aj MS F 
ro Bro 2 7n 642 F 3040 ame 2 1.60 <1 
45 1.20 i i 
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which enabled the testing of the effects 
of initial learning conditions upon sub- 
sequent performance. In future experi- 
ments designed to assess the quality of 
performances of individuals and of 
groups of varying size, the experi- 
menters should be concerned not only 
with performance in the initial situation 
but also in a subsequent one. It would 
have been possible in the present ex- 
periment to have grouped the individu- 
als into pairs and quads for the transfer 
problem instead of having those who 
learned initially in pairs dnd quads to 
work subsequently as individuals. The 
present design thus permits the deter- 
mination of the effects of initial learn- 
ing in groups of varying size upon 
subsequent performance as individuals, 
and vice versa. 

One substantive result of the experi- 
ment is that pairs and quads perform 
more efficiently initially than do indi- 
viduals; but subsequently, when work- 
ing as individuals, those who learned 
originally as individuals perform signifi- 
cantly better than those who learned 
in pairs and quads. The first conclusion 
is in agreement with other investigations 
reported earlier in this article, The 
latter conclusion cannot be checked 
with other experiments, for no other 
reports were found in which the attempt 
was made to investigate this phenome- 
non, Although this conclusion may be 
applicable only to the specific experi- 
mental arrangements as described, it 
emphasizes clearly the conclusion of 
Lorge et al., (1958) and Duncan (1959) 
that the superiority of group perform- 
ance in comparison with individual per- 
formance has not been fully established. 

The crossover in efficiency of indi- 
viduals and quads may be explained 
tentatively. In the initial learning situa- 


tion, the pairs and quads secured a 
large amount of information in a rela- 
tively short period of time, analyzed 
the information correctly, recalled the 
information, and deduced the correct 
concepts. Pairs and quads accomplished 
this better collectively than did indi- 
viduals working alone; however, not 
all the members of the pairs and quads 
learned well. When on their own and 
working individually on the transfer 
problems, they could not apply, for 
they had not learned. Working alone 
initially, the individuals »often guessed 
incorrectly what the concept was with- 
out having complete information, or did 
not analyze the information correctly, 
or did not recall it well. However, each 
individual was active and mist of them 
improved performance across concepts 
during the initial learning and also 
learned how to go about the task. They 
continued improving in the transfer 
situation by applying the learning-t0- 
learn procedures in the transfer situa 
tion. 
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A follow-up study was completed toward the end of the Sth grade to 


determine the effects of accelerating brig 


ht older pupils from 2nd to 4th 


ge after a 5-weck summer session. The Ss were 1 group of 10 boys 
and 10 girls, above the median CA of 2nd graders prior to being acceler- 


ated; 2 groups of 20 nonaccelerated 5th graders of superior 
1 above and 1 below the median C 
and, 2 groups of 20 nonaccelerated 
1 above and 1 below the median CA of nonaccelerated Sth 
No unfavorable academic, social, emotional, 
of acceleration were found. A com 
research on acceleration without skipping of c 
of superior abilities should complete the bacc: 


«than age 21. 


abilities, 
A of nonaccelerated 5th graders; 


Sth graders of average abilities, 
h graders. 


or physical correlates 


parison of these results with other 


ontent suggests that pupils 
alaureate degree no older 


oeenn 


im nurturance of the emerging 
all pu a affective characteristics of 
school. Th is the primary task of the 
the wide t is a difficult task because of 
abilities variability among the pupils in 
also bec and other characteristics and 
ministrative of relatively inflexible ad- 
Permit ada arrangements which do not 
ences, ENE to individual differ- 
not faciliiat, of these arrangements do 
Driate = ate bringing together appro- 
Yet aa eng and the abilities of pupils, 
bina th of learning might be vastly 
Change j through a relatively simple 
Tan n connection with acceleration. 
iy school systems require children 
‘the =a a chronological age of 

o enter. s3 as of September 1 in order 
uire © the first grade, They also re- 
ars po child to spend at least 12 
Schoo] ompleting 12 grades. In these 
systems, the median age of en- 


1 T $ 
Improv study was supported by the Wisconsin 
Cd Te Ment Program—Local School Systems 
F AT Education, and by the Research 
Universite of the Graduate School of the 
Brittin of Wisconsin with funds from the 
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tering first graders is 6-3, and the range 
is from 5-9 to 6-9. The pupils who 
spend 12 years completing the 12 grades 
are about 17-6 to 18-6 when graduat- 
ing from high school in June and about 
21-6 to 22-6 when graduating from col- 
lege. The age at which most students 
are graduated depends upon the date of 
birth, not on any intellectual, educa- 
tional, social, emotional, or physical 
characteristic. 

There are as many bright and emo- 
tionally, socially, physically mature 
children among the older half in chron- 
ological age entering the first grade as 
there are below average, and emotion- 
ally, socially, and physically immature 
children among the lower half in chron- 
ological age. To keep an older bright 
child throughout his school life with 
younger, less mature children keeps him 
out of a productive career for at least 
ay also reduce his learn- 


1 year, and it m 
d motivation for learn- 


ing efficiency an 
ing. 

Adherence to a S 
per year is no longer feas 


chedule of one grade 
ible since ac- 
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celeration can be accomplished without 
skipping any essential content. How- 
ever, the only controlled experiment re- 
ported thus far, dealing with the ac- 
celeration of bright, older, elementary 
school pupils, was by Klausmeier and 
Ripple (1962). The effects of accelerat- 
ing bright, older pupils from the second 
to the fourth grade after a 5-week sum- 
mer session were favorable toward the 
end of the fourth grade. In this article 
the effects of acceleration toward the 
end of the fifth grade are reported and 
discussed. 


METHOD 
Subjects 


The subjects were 50 girls and 50 boys, 10 
of each sex having been accelerated from the 
second to the fourth grade, and currently 
enrolled in the fifth grade. The other four 
groups of 10 girls and 10 boys each were two 
groups of fifth graders of superior abilities, 
one above and the other below the median 
age of fifth graders; and two groups of fifth 
graders of average abilities, one above and 
the other below the median age of fifth 


graders. Hereafter, the five groups are desig- 
nated: 


1. Acc—referring to the accelerates 

2, 5SY—referring to the nonaccelerated 
pupils of superior ability below the median 
age of normally progressing fifth graders 

3. 5SO—referring to the nonaccelerated 
pupils of superior ability above median age 

4. SAY—referring to the nonaccelerated 
pupils of average ability below median age 

5. 5AO—rcferring to the nonaccelerated 
pupils of average ability above median age 


Two other groups, originally third graders 
in the first year of experimentation, were not 
included in the follow up, one because about 
half of its members were accelerated from 
third to fifth grade and the second because 
appropriate standardized educational achieve- 
ment testing could not be carried out during 
the follow up in the fourth grade. 

As beginning fifth graders the mean chron- 
ological age of Acc was 9-6; the mean of 
5SY and 5AY was 10-0, and the mean of 
5AO and 5S0 was 10-5. If no further ac- 
celeration is done the Acc will be graduated 
from high school in June at a mean age of 
17-4, 5SO at a mean age 18-3, with the range 
from about 17-9 to 18-9. 


Data Gathered and Treatment of Data 


Nine types of data were gathered on each 
pupil toward the end of the fifth grade, using 
the same instruments as were used toward 
the end of the fourth grade, except that 
different forms of standardized tests were 
used. The reliability and validity of the ratings 
and other scores were reported in some detail 
previously ` (Klausmceier & Ripple, 1962) and 
are not presented again. 

A brief description of cach instrument fol- 
lows. ; 

Educational Achievements. The Metropoli- 
tan Achievement Tests, Intermediate Battery- 
Partial were administered to all pupils. Scores 
were obtained for Word Knowledge, Reading, 
Spelling, Language Total, Language Study 
Skills, Arithmetic Computation, Arithmet 
Problem Solving and Concepts, and Total m 
tery. The raw scores obtained were pa 
to standard scores, using the data in t 
manual accompanying the tests. I 

Problem Solving Ability. A test of 25 mu fi 
tiple-choice items was devised by the anios 
and research assistant, Richard Ripple, ete 
at Cornell University, to assess a compon 
problem solving ability as represented in ia 
dealing with analogies, logical reasoning, Po 
tinent questions, sensitivity to problems, nay 
following directions. Each item correc 
answered was scored 1. af 

Creative Thinking Abilities. Seven tests a3 
creative thinking yielding 10 scores were be 
ministered to all pupils: Object Uses, wa 
Uses, Plot Titles, Expressional Fluency, r 
Questions, Object Improvement, and Sentet 
Improvement. These tests, except S 
Improvement, were adapted from Guil pe 
(Guilford, Kettner, & Christensen, 1956) >} 
Frank B. May, Research Assistant, now ith 
Washington State University, for use e 
children. Sentence Improvement was devas 
by May. The reliability coefficients of ihe 
instruments were reported previously Calta 
meier & Ripple, 1962); validity and ol =i 
information about cach instrument were P! 
sented by May (1961) and Ripple (1961). ag 

Psychomotor Abilities. Four tests of iA 
chomotor abilities were devised and ad on 
tered by Grace Piskula, Physical BAUCH aa 
Supervisor of the Racine public schools: di- 
ketball Throw to measure strength and on 
nation of body and arms, Jump and Reat 1l 
measure coordination of arms and legs, 
Pass to measure eye-hand coordination 
speed of reaction, and Shuttle Run to meas 
running speed and maneuverability. ob- 

Handwriting Skills. A speed score Wes ar 
tained by having each pupil write a stan tes- 
Sentence as rapidly as he could for 3 mint 


an 
ure 
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B was a count of the number of words 
havin n. A legibility score was obtained by 
Snes ane pupil write the standard sentence 
sataple us normal speed of handwriting. This 
scale BG rated by two judges on a 9-point 
Heh aces ee were summed and a 
MA taling.  indicative ‘of high, lesibility. 
ae Ue of Virgil E. Herrick, University 
i sconsin, for administering and scoring 
tests were followed. 
ue an ee A sociometric instrument 
best frie a which the pupils listed their five 
Pupil ft a es order. A score for each 
received pos- tained by tabulating the choices 
choice, es the choices (5 for a first 
the weighted e choice; etc), andada 
a e ge School and Learning. A 
10 ages fe and an inventory were devised 
and learni e pupils’ attitudes toward school 
Liked Be ae: The ranking scale, titled Places 
school dace required the pupil to rank the 
ighest Onn and eight other places from 
ence for th o lowest (9) on the basis of prefer- 
or the cla places. A low numerical ranking 
the de indicates high preference for 
places: fa om in relation to the other eight 
gym, we library, city park, school 
ground, home. ood, public library, school play- 
Eo Pen Inventory consisted of 24 
indicate he ae which required the child to 
With school iking for something connected 
Ethi a 
was a aes A multiple-choice inventory 
ant, Willia y the writer and research assist- 
Niversit m Franzen (1961), now at Toledo 
Were Beye to assess ethical values. Responses 
tional co as to whether they indicated ra- 
Housness nscientiousness, irrational conscien- 
Ness, The group conformity, or self-centered- 
these a inventory yielded a score for each of 
conscienti, traits. A high score on rational 
ore d Ousness was interpreted as being 
Other oe than a high score on any 
the lett ait, Item 1 of the inventory follows; 
Ndicat ers in parentheses following each choice 
e the keying: 


Bo i 
ent girls are usually told not to run 1m 
alls, You would 


A. i . 
an in the hall to report a child injured 
p, cu the playground. (RC) 
ane in the hall only when other boys 
c as girls do. (GC) 
fee run in the hall because it is WF 
D © do so. (IC) 
i a in the hall in order to get to class 
n time, (SC) 


‘ong 


Intellectual and Affective Characteristics. A 
Teacher Rating Scale was devised by Klaus- 
meier and Ripple, consisting of 12 descriptive 
items. The teacher rated the pupil on each 
item, using a 4-point scale. Weights of 1 to 4 
were given to each item and a total score was 
obtained by adding the weighted scores. 

A 2x5 analysis of variance was run to 
determine the significance of difference among 
the means of the five groups. Where the differ- 
ence was significant at the .05 level or beyond, 
a Tukey gap test was run to ascertain which 
groups were significantly higher or lower than 
‘Acc. Differences between other groups, such 
as SAY and 5S0, are not presented in the in- 
terest of brevity and conciseness. 


RESULTS 


In Table 1 the mean scores and 
standard deviation units are presented 
for the total boys and girls in each 
group, an indication of whether the 
F ratio among the means of the five 
groups was significant at or beyond the 
‘05 or the .01 level, and an indication 
of whether boys or girls were signifi- 
cantly higher. 

The difference among the means for 
the five groups was significant for 25 
measures but not for the following 8: 
Word Uses—fluency, Plot Titles—flu- 
ency, Basketball Throw, Handwriting 
Speed, liking for the school classroom, 
attitudes toward school and learning. 
group conforming values, and self- 
centered values. In general, 5AY and 
5AO groups were lower than the other 
three groups on the 25 measures where 
the difference was significant. The sex 
x group interaction was significant at 
the .05 level for one variable, namely, 
teacher rating of intellectual, social, 
and emotional characteristics. Subse- 
quent Tukey gap tests on this variable 
for each sex resulted in a significant 
difference among the means at the .01 
level as noted in Table 1. 

The girls were significantly higher 
than the boys in five measures: Plot 


Questions, Object Improvement, Hand- 
writing Legibility, Rational Conscien- 
tious values, and teacher rating. The 
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TABLE 1 


Means, STANDARD DEVIATIONS, AND SIGNIFICANT F Ratios ror 33 MEASURES 


Significance of 


5S0 Acc 5SY SAO SAY F Ratio 
Medsure MSD M SD M SD M SD M SD Groups Sex 
Metropolitan Achievement 
ests 4.65 5.09 01 ns 
Word Knowledge ce w ane 
Reading 6.19 745 Ol oms 
Spelling 4.59 7.75 0l ns 
Language Ri Sills 273 832 ‘01 ns 
guage Study Skills x $ N: 
rents Computation 5.89 6.65 Ol 
Arithmetic Problem Solv- Saj sei oi ats 
ing and Concepts n eet oh ae 
Social Studies Skills s ; . 
i 2.95 3.93 01 a 
Problem Solving a : J 
Creative Thinking Battery m i os as 
3 ji 6.30 2.20 7.10 3.08 7.10 3.40 4.60 2.80 430 2.13 | G 
a oe 14.95 3.25 18.05 4.51 18.10 4.62 12.30 4.59 1235 4.50 <01 05G 
Object Improvement 5:65 2.81 6.65 3.03 560 2.04 350 1.54 430 232 SE e 
Sentence Improvement 15.70 $02 18.15 4.40 13.80 4.70 11.20 415 800 368 <05 ” 
Object Uses—fuency 17.65 3.87 19.75 6.21 19.25 6.70 14.75 3.92 14.25 476 05 "3 
Object Uses—fexibility 6.50 2.96 690 4.03 5.60 270 450 302 445 254 05 % 
Word Uses—fluency 2-73 3.95 945 390 10.90 3.46 8.75 342 970 409 ns MS 
Word Uses— flexibility 645 136 6.65 179 620 128 540 154 510 148 05 Ħ 
Plot Titles—fluency S13 237 560 2.52 635 216 4.60 170 5.25 316 ns M 
Plot Titles—cleverness 2.35 1.76 4.25 2.84 3140 237 180 161 270 205 05 
Psychomotor Abilities B 
“Shuttle Run 7.05 89 7.60 68 7.25 64 93 6.60 9 01 OLE 
Wall Pass 10.40 3.05 12.05 2.96 11.20 2/48 289 9.95 251 05 ‘Sip 
Jump and Reach 8.90 2.43 10.25 1.92 9.25 1.59 1.89 8.65 3.03 05 ‘01B 
Basketball Throw 33.80 15.86 39.10 15.20 35.60 10.60 12.34 34.15 11.69 ns “hs 
Handwriting Speed 51.40 10.76 57.40 10.16 55.45 9.41 10.49 49.00 12.98 #5 ig 
Handwriting Legibility 14.10 2.75 16.40 3.28 14.80 3.19 1.96 13.20 2.31 0l 
Sociometric Choices 12.65 9.17 21.40 11.65 14.25 9.41 12.12 9.05 6.95 OL as 
5 
Places Liked Best 5.85 2.25 5.85 2.43 6.45 2.68 2.52 7.20 2.21 m8 T 
Attitude Inventory 52.85 6.38 55.70 5.14 53.85 6.53 8.31 50.40 8.04 ns è ” 
Ethical Values Inventory 05G 
Rational Conscientious 10.80 2.46 11.35 2.72 9.85 3.10 7.75 2.75 8.05 3.36 0l a 
Irrational Conscientious 2.95 1.99 2.80 1.67 3.70 2:43 510 236 430 314 Ol 05B 
Group Conforming Bs go St dS 08 as Go to oe mo 08 
Seli-Centered 1.80 1.61 1.70 1.38 2.00 1:38 2.55 211 3.00 1.75 ms i6 
Teacher Rating 34.50 4.42 38.80 4.58 32.50 5.66 26.80 5.98 24.85 538 01 © 
Fais . 3 z ich 
boys were significantly higher than the third column are given the groups ae 
girls in five measures: Shuttle Run, Wall were higher than Acc. Since the di 


Pass, Jump and Reach, Basketball 
Throw, and Group Conforming values. 
Possibly, no differences should have 
been expected between boys and girls 
in educational achievements since each 
child had to meet the same minimum 
criterion of educational achievement 
when originally selected for inclusion in 
the various groups. 

In Table 2 are given the comparisons 
of Acc group with each other group on 
the 33 measures. In the first column 
of Table 2 are listed the groups which 
did not differ significantly from Acc on 
the various measures; in the second 
column are given the groups which were 
significantly lower than Acc; and in the 


o 
ence among the five groups was ae 
significant on eight measures, ACC cog 
does not differ from other groups 


c 
these eight measures. Further, AY 
group was between SSO and 5 the 


groups on some measures where - 
difference among the five groups sie 
significant and thus may not be siga er 
cantly different from any of the oth 
four groups. 

The results pertaining to the 
parison of Acc group with each Ot 
group are now given, according tO 
main types of data gathered. fe 

1. On eight scores of the Metrop? 
tan Achievement Test, Acc group T 
not significantly different from the r° 


com” 


the 
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TABLE 2 


SUMMARY or DIFFERENCES BETWEEN THE ACCELERATED AND THE Four Comparison GROUPS 


on 33 MEASURES 


Not significantly Significantly Significantly 


“Acher Rating 


550, SSY 


Measure different from lower than higher than 
Acc group Acc group Acc group 
Metropolitan Achievement Test 
Word Knowledge sSY 5S0 
Reading = * 350, 5SY 
Spelling 550. 5SY 
Language Total sSY 5S0 
Language Study Skills 580, 5SY, 5AO 
ie ae Computation 5S0, 5SY 
roblem Solving and Concepts 5S0, 5SY 
Social Studies Skills 580, 5SY, SAO, SAY 
Problem Solving 380, 5SY SAO, SAY 
Creative Thinking Battery 
Expressional Fluency 580, SSY, SAO, SAY 
Plot Questions 550,5 Y 5 
Object Improvement 550,5 5AY 5A0 oa 
Sentence Improvement 550, 5A0, SAY 
Diet Uses—fluency 550, AY 
5 bject Uses—flexibility 550,5 Y 
Yord Uses—fluency 5S0, 5 AY j 
i ord Uses—flexibility 550.5 SRy 
lot Titles—fluency 350, 5 sAY 
lot Titles—cleverness 550 5AY 
Psycho 
motor Abiliti 5 
Shuttle Run cs 580, 5SY, SAO, SAY 
Wall Pass 350, 5SY, SAO, SAY 
iting and Reach 5S0, 5SY, SAO, SAY 
‘asketball Throw 550, 5SY, 5A0, SAY 
andwriting Speed 550, 5SY, 5A0, SAY sep 
andwriting Legibility 5SY, SAO, SAY 3 
Sociometric Choices 550, 5SY, SAO, SAY 
Places Liked Best 550, SY, 5A0, SAY 
Atti m 
ttitude Inventory 580, 5SY, SAO, SAY 
Ethi 
cal Values Inv 
H ventory 5. 
nul S 5S0, ae SAY TAOSAN 5A0 
ational Conscienti 550. 5SY, Sé i 
soup oo 550, SS¥, SAO, SAY 
clf-Centered 5S0, 5SY, 5A0, SAY 
5AO, SAY 
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accelerated 5SY and 5SO groups, ex- 
cept in Word Knowledge and Language 
Total where 5SO was significantly 
higher; Acc group was significantly 
higher than the nonaccelerated 5AO and 
5AY groups except in Language Study 
Skills, where SAO group was not signifi- 
cantly different. 

2. In Problem Solving as measured by 
a special test, Acc group was signifi- 
cantly higher than SAO and SAY groups 
and not significantly different from the 
nonaccelerated 5SO and SSY¥ groups. 

3. On 10 tests of creative thinking 
abilities, Acc group was not significantly 
different from any other group, except 
on Object Improvement, Sentence Im- 
provement, and Word Uses—flexibility ; 
on these Acc group was higher than one 
or both 5AO and SAY groups. 

4. In six Psychomotor Abilities Acc 
group was not significantly different 
from any nonaccelerated group except 
in Handwriting Legibility, where 5SO 
group was significantly higher. 

5. In number of choices received on 
a sociometric test, Acc group did not 
differ significantly from any other group. 

6. In liking for school and learning, 
Acc group was not significantly differ- 
ent from any other group, 

7. On four measures of ethical values, 
Acc group was not significantly different 
from the nonaccelerated 5SO and 5SY 
groups; it was significantly higher than 
5AO and SAY in Rational Conscientious- 
ness and lower than 5AO in Trrational 
Conscientiousness, 

8. In teacher ratings of the intellec- 
tual and affective characteristics of the 
pupils, where the sex x group interac- 
tion was significant, subsequent tests for 
each sex showed Acc boys and girls to 
be significantly higher than 5AO and 
SAY boys and girls and not to differ 
significantly from 5SO and 5SY boys 
and girls. 

In summary, toward the end of the 
fifth grade and the second year after 


acceleration, the accelerated pupils were 
equal to or surpassed the nonaccelerated 
pupils of average abilities and the 
younger pupils of superior abilities in 
all measures of intellectual and psycho- 
motor abilities and adjustment; also, 
the accelerated pupils were significantly 
lower than nonaccelerated older bright 
pupils only in Word Knowledge, Lan- 
guage Total, and Handwriting Legibility. 


Discussion 


A principal objection to acceleration 
is that essential subject matter content 
is skipped, resulting in lower educa- 
tional achievement of accelerated stu- 
dents. This objection was shown to be 
invalid in this and other experiments: 
In Table 3 are presented methods of ac- 
celeration which do not involve ne! 
skipping of content, the school level @ 
which experimentation has been done; 
and indication of the reference in which 
the results are reported as favorable in 
terms of the educational achievements 
of the accelerates, 

Other objections to acceleration te 
volve about the personal, social, 4 
emotional adjustment of the accelerates: 
In Tables 1 and 2 of this article, sub- 
stantial evidence is presented that 2° 
celerating bright older pupils, after at; 
tending school in the morning for 
weeks during the summer, produces no 
undesirable effects on their personal, an 
cial, or emotional adjustment. The sam” 
conclusion was drawn in the other ¢* 
periments cited in Table 3. 0 

Since acceleration by one or ot 
Semesters without skipping may be pod 
complished at any school level with a 
sirable results, it appears unwise to ma f 
bright students to spend 12 years ip 
completing high school and 16 years i 
completing the requirements for the ae 
calaureate degree. Terman (1954) ie 
vored gifted students entering colle” 
not older than age 17. In terms of p!® 
ent shortages of teachers and ot 
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TABLE 3 


MEANS OF x J 
S OF ACCELERATING PUPILS WITHOUT SKIPPING OF SUBJECT CONTENT 


Method 


Level of schooling Investigator 


Being admi i 
Pi itted early to kindergarten or first 


Completi ; 
aa six semesters of the nongraded 
Aand ry school in four or five semesters 
i : 
of a paa session, mastering content 
ext higher grad i i i 
-ney de, going 
F acide i i going into higher 
Ondensing or c : 
Gen pi A compressing content into shorter 
eriods, e.g, 3 year English i 
2 years g» years of English into 
aking adva 
the ee EE college placement courses in 
aking a year of high school 
i itional classes and summer session 
tendance . 


T 


Hobson, 1948 
Birch, 1954 
Worcester, 1956 
Klausmeier, 1962 


Preschool 


Primary school 


Elementary school Klausmeier and 
Ripple, 1962 
Justman, 1954a 
Justman, 1954b 
Klausmeier, 1962 
Meister, 1956 
Barnette, 1957 
Flesher and 
Pressey, 1955 


Junior high school 


Senior high school 


College 


educa 
ee le, an appropriate national 
right et a goal might be to have all 
teate de 7 ents complete the baccalau- 
birthda gree at least by their twenty-first 
thats, the most able and rapidly 
compulsi y age 20. Since we have 
of all agit public education of pupils 
ë nn excellent nurturance of 
more is a abilities of the top 5% or 
ject co proved when appropriate sub- 
ntent and emergent abilities are 


Tou ; 
ration into harmony through accele- 
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USE OF WRITTEN 


RESPONSES IN THE 


STIMULATED RECALL METHOD! 


C. J. KRAUSKOPF 


Ohio State University 


To determine whether written responses could be substituted for oral 
responses in the stimulated recall technique, 53 students from a course 


in general psychology were given 


ality defense mechanisms, and asked to writ 


tape recorded presentation of the 


a lecture on intelligence and person- 


€ responses to a subsequent 
original lecture. The responses were 


rated for relevant thought and correlated with an immediate test and 


with final grades in. the general 
cant at the 01 or .05 level were 


psychology course. Correlatio: 


ns signifi- 


obtained with both criteria, It’ was 


concluded that written responses were sufficiently reliable and valid to 
use in further investigation of classroom learning, 


Most of the research in classroom 
learning has consisted of manipulation 
of the classroom situation and measure- 
ment of amount of material retained 
under various conditions, e.g., discussion 
versus lecture method of presentation. 
The method of stimulated recall ap- 
pears to be a promising technique for 
investigating responses that occur in all 
classroom situations, but that are not 
easily measurable by the currently most 
frequently used techniques. The stimu- 
lated recall method elicits additional 
observable responses related to thought 
content and process and to degree of 
attention. 

The technique of stimulated recall as 
used in the past by Bloom and others 
(Bloom, 1954; Gaier, 1950; Shulz, 
1951), involves the following steps: 
(a) the tape recording of a classroom 
session, lecture, discussion, or similar 
material; (b) the playback of this tape 
in individual interviews, stopping the 
tape in several places and asking the stu- 
dents to state what they were thinking 
about at that point in the original class; 
(c) rating the responses as to the de- 


1 Based on the author’s doctoral disserta- 


tion (Krauskopf, 1960). ; i 
2 Now at the University of Missouri. 


Se 


gree to which those thoughts were le 
vant to the lecture. Bloom (19 
classified the thoughts reported, 


in terms of their relationship to the r a 
problem being discussed at the time. an ae 
index was derived to represent the APE re 
mate proportion of the thoughts which W 
relevant [p. 167]. 


It appears that such ratings provide a" 
indication of the nature and degree 5 
covert class participation of studen A 

The research on learning in the class- 
room seems to be adequately oi 
marized by Jacob (1957). Reference il 
previous use of the stimulated a 
technique can be found in articles 53 
Gaier (1952) and by Bloom a9 E 
1954). The responses so obtained ha ge 
been compared, in lecture and qisar 
sion, with observable behavior and W! 
personality variables. The degree je- 
which “thoughts” are found to be re ae 
vant to lecture material seems to be rê z 
tively independent of overt parnik 
tion in class and to be a good predic 
of course grades (Bloom, 1953). js 

The purpose of the present study 
to determine the effectiveness of a ores 
method of collecting thought respo te 
in which subjects were asked to Ta 
down their responses to the origi 
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on eee If effective, this procedure 
bes permit more efficient use of re- 
rch time in collecti 

Pati be llecting data, and more 
bl Investigation of classroom 
a ning might be carried out in a man- 
rasa possible with the more common 
i niques involving extensive individual 
nterviewing. 


METHOD 


Thi > P 
studa y Periment was conducted with 54 
an ane second quarter freshmen, in 
they appr etary psychology course. In ability 
freien oximate the general distribution of 
Examiagign the Ohio State Psychological 
the subjects? (OSPE). The x? test between 
tion of the i OSPE scores and the distribu- 
of less than iyo class yields a probability 
tween the dis 0 that there is a difference be- 
ecriplate Pip One student failed to 
the study: course and was dropped from 


Hypotheses 


A P 

il je el hypotheses to be tested, stated 

. The potheses, follow: 

high ah a is no difference between students 

relevant moa thought and students low on 

Psychology Ought during a lecture on general 

Plication , in performance on a test of ap- 
of principles and interpretation of 


ata coveri 
chology, ne material from general psy- 


as 


l e è 
high ie is no difference between students 
Vant Goon thought and low on rele- 
Psycholo ugh during a lecture on general 
wae in their final grade for the course. 
S predicted that the null hypotheses 


Would e 
Was PORE cee The .05 level of probability 
nu ed as a criteri jection of the 
11 hypotheses. erion for rejection © 
P. 
tocedure 


A 
enera te consisting of material from the 
Yet peas chology course, but which had not 
Tietotie eae in the subjects’ class, Was 
© eac and presented by the experimenter 
tapeq a group of students. This lecture was 
The stode then played back an hour later. 
a € as P were instructed to follow the 
2 ape ey had the original lecture, and when 

€Y ha stopped, to write down whatever 
Not to Ppened to be thinking at that moment, 

Worry about complete sentences, but 


to get down quickly whatever they were 
thinking, whether it was on the topic of the 
lecture or not. The tape was stopped at 
seven critical points, where a student could 
draw a conclusion or synthesize material, and 
at eight other predetermined points. 

An immediate test was given consisting of 
application of principles and interpretation of 
data items. The items were drawn from ma- 
terial covered earlier in the general psychology 
course, or were answerable from the data 
presented. 

The responses obtained during the playback 
were then rated by two judges independently 
for relevant thought. The ratings were made 
by classifying the students’ papers into six 
categories, from highly relevant, active use of 
outside material in the first category to de- 
gree of irrelevant material and incorrect in- 
formation in the sixth category. Instructions 
to the judges were to rate the papers on 
relevance of material, references to self- and 
personal experience, assigning Number 1 to 
the best papers through Number 6 to the 
worst. Almost pure passive listening was to 
be rated about the middle. Wrong information 
and misinterpretation of material presented 
was to be rated low. 

These ratings were intercorrelated, using the 
Pearson r, with the score on the immediate 
test, the final course grade in general psy- 
chology, and OSPE score. In order to esti- 
mate the overlap of the relevant thought 
ratings with a standard predictor of course 
grades, partial correlations were computed 
between the ratings and both the immediate 
test score and final grade with OSPE held 
ant. Multiple correlations were also com- 
Jevant thought rating 
d to predict the test 


const 
puted in which the re 
and OSPE score were use 


and course grade. 

The ratings used in the computations were 
combined numerical ratings of the two judges. 
The correlation between the ratings of the two 


judges was .77. 


RESULTS 


among the relevant 


Intercorrelations 
s, immedi- 


thought ratings, OSPE score: 


ate test scores, and final grades in gen- 
d and are 


eral psychology were compute 
presented in Table 1. 
The means and standard deviations 


of the various scores are presented in 
Table 2. 
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TABLE 1 


INTERCORRELATIONS OF RELEVANT THOUGHT 
Ratinc OSPE, Test SCORE, AND FINAL 
GRADE IN GENERAL PsycHOLOGY 


Relevant ; 
thought Final 
rating OSPE Test grade 
Relevant 
thought 
rating 08 56** = .27* 
OSPE 08 30* 65** 
Test SO**  30* n 34* 
Final grade .27* GS** * 34% 


NIN 


4 = 05. 
5 = 


These results indicate that the hy- 
pothesis of no difference between stu- 
dents high and low on relevant thought 
on an immediate test of application of 
principles and interpretation of data 
items can be rejected at the .01 level of 
probability and that the hypothesis of 
no difference in final grades for the 
general psychology course can be re- 
jected at the .05 level, 

The partial correlation between rele- 
vant thought rating and immediate test 
score with OSPE constant is 60, The 
partial correlation between relevant 
thought rating and final grade, with 
OSPE constant is .31, The multiple 
correlation of relevant thought rating 
and OSPE with immediate test score is 
.61. The multiple correlation of relevant 


TABLE 2 


MEANS AND STANDARD DEVIATIONS oF RELEVANT 
Tuoucut RATING, OSPE, Test Score AND 
FINAL GRADE IN GENERAL PsycHoLocy 


Relevant 
thought 
Statistic rating 
(com- Final 
bined) OSPE Test grade 
M 3.86 56.0 20.6 209 
SD 1.06 24.1 2.93 35.6 


thought rating and OSPE with final 
grade is .68. 


Discussion 


Academic Prediction with Written 
Responses 


Table 1 indicates that the two Coot 
null hypotheses should be rejected. 
Other criteria are needed to evaluate 
the usefulness of written responses as 4 
research tool. In order to be maximally 
useful a new predictor should add to oF 
improve on other standard pee g 
academic performance, such as OSI i 
The partial correlation of the pelaan 
thought ratings and the immediate oot 
with OSPE held constant indicates tho» 
the ratings add substantially to the pri 
diction of application of principles ane 
interpretation of data test items. it 
partial correlation of the ee 
thought ratings and the final oan 
grade with OSPE constant indicates a 
this might add something to the pre : 
tion of grades in general psychology: 
The multiple correlations of .61 and Re 
for the combination of relevant aw 
and OSPE with immediate test and a 
grade add to predictive efficiency in bO 
cases, we 

The correlation of OSPE and h 
relevant thought ratings is low — 
to suggest that something is being me it 
ured other than what is usually patie 
ured by the standard predictors, © 
OSPE. sti 

Bloom (1953) reported greater ‘ure 
culty in predicting grades from lec 
material than from discussion, but ate 
gives only one correlation coeffioe in 
In this study there was no disous a 
by subjects during the original prese! re 
tion, but in a pilot study where 
was discussion by the subjects aan o 
the questions by students seeme ats 
focus the attention of other studen?” 
Additional research seems indicate 
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in i i 
g discussion classes and obtaining 
written responses. 


Possible Explanation 


ren method provides information 
Sie ee to obtain about at- 
af so : The attention attracting power 
oo TeS is very high. For ex- 
ia Sho pae does little Pierre belong 
of the Si (in reference to the history 
tsition aN Binet) received the at- 
side he nearly every student. Out- 
une are occasionally very at- 
overhead An airplane passing close 
iia cept the attention of most. 
tractive en in the room were at- 
ment si e room in which the experi- 
ote: Gee had electrical re- 
act ioen Gan from the ceiling, a 
Some tin y many of the students at 
examples during the lecture. Other 
Seem suff could be given, but these 
at eS to illustrate the point 
aking r en is an important factor in 
serves oe thought ratings. An 
e studene. no way of differentiating 
oward the Whose attention is directed 
Who is] aseteta from the student 
Planning toe at the instructor and 
Stroup, San next dance for his social 
method of imulated recall provides a 

cordi making this differentiation. 
age ES to Bloom (1954) the per- 
attention time during which a student’s 
Matter + is directed toward subject 
bot i greater during discussion. In 
Study oee study and the present 
indicate e stimulated recall responses 
tion, n, Walitative differences in atten- 
to be o ese qualitative differences seem 
Tnattenti, an active-passive dimension. 
as, «pa ON is indicated by responses 
Psycho] like to be out with Mr— [her 
the nee instructor] right now.” At 
Suc hao end of the dimension are 
"ebeatt Sponses as, “just listening” oF 
ture, ing the last statement in the lec- 
thers appear to spend much of 


the time applying information to people 
they know, e.g., “That sounds like my 
roommate.” And still others make more 
general applications, “I wonder how 
many feelings are not hurt because of 
repression.” 

As the papers are evaluated the first 
factor considered is the ratio of state- 
ments indicating attention to those in- 
dicating inattention, a quantitative con- 
sideration of attention. The second 
factor considered is a qualitative differ- 
ence in the statements indicating atten- 
tion. Are these active or passive? 

A third factor is the way in which a 
student considers outside material, in- 
formation which was not present in the 
lecture presented. For example, “We 
studied something like this in sociology 
class. The instructor said intelligence 
was hard to determine.” Or, “Fred is 
an example of this. He daydreams all 
the time.” This type of response is not 
present except in those papers which 
would be evaluated as having active 
attention. After the amount and quality 
of attention are used to differentiate 
the responses, a further differentiation 
is made on the basis of integration of 
outside material. 

Bruner, Goodnow, and Austin (1956) 
define categorizing as, “Additional in- 
ferences about other unobserved proper- 
ties of the object or event [p. 244] .” All- 
port (1954) mentions categorizing as 
classifying perceptual evidence. A per- 
son then infers other characteristics of 
a stimulus from the class to which it 
is assigned. Fragments of this catego- 
rizing process are apparent in the stimu- 
lated recall responses. For example, in 
reference to M. Itard in the story of the 
Wild Boy of Aveyron (Valentine & 
Wickens, 1949), “Must be a psycholo- 
gist, sounds like one.” To this student, 
one who takes on this type of training 
task is a psychologist. In another case 
a student finds an example for a newly 
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acquired category, “Conversion behavior 
—my roommate making herself have a 
headache.” 

In retrospect the evaluation of the re- 
sponses was made by judging the amount 
and quality of attention, the integration 
of outside material, and the amount and 
quality of categorizing. 


Suggested Research 


It has been possible to reliably rate 
stimulated recall material for relevant 
thought with both individual interviews 
(Bloom, 1953) and, in this experiment, 
written responses; however, it would 
be useful to have data on the reliability 
of the technique in a test-retest situa- 
tion, Also, if a better scoring system 
could be devised, it would be interesting 
to know whether there were any differ- 
ences in the relevant thought stimulated 
by widely varying types of subject mat- 
ter, e.g., physical sciences versus hu- 
manities. Bloom (1954) has identified 
differences resulting from use of lecture 
and discussion methods of presentation, 
but some individual students may show 
more relevant thought in a class where 
the scientific method of inquiry is em- 
phasized and others in a class where 
the historical method is emphasized. 

Courses in logic often claim as an 
aim of the course to teach students a 
different method of thinking. The Ohio 
State University College of Law is able 
to state definite ways in which they 
wish to change the thought processes 
of their students. If a scoring system 
can be devised based on the methods of 


categorizing information which are de- 
sired, it may be possible to investigate 
changes in thought processes through 
periodic administrations of this tech- 
nique throughout the course. It may 
also be possible to identify the eco 
which produce a high proportion © 
tangential thought. 
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CONCEPT ATTAINMENT AND ADOLESCENT 
DEVELOPMENT 


LEE YUDIN ° anp SOLIS L. KATES 
University of Massachusetts 


Tie purpose of this experiment was to determine if concept attainment 
ficiency and strategics were related to adolescent development and 


method of presenting information. 


There were 40 Ss at the 12-yr., 


14-yr., and 16-yr., levels, respectively, all of average intelligence. 


4 groups of 30 Ss, 10 from each age 


level, solved 6 concept problems. 


ee was given a different presentation of information. The Ist 
ieee = was supported. The 14- and 16-year-old Ss were not different 
aa ae other and were superior to the 12-year-old Ss on efficiency 
ee rategies. The 2nd hypothesis was not supported. Positive or nega- 
ive series, transmitting equal information, appeared to have no different 


effects upon efficiency and strategies. 


tne mene of this study was to de- 
cept att if efficiency and strategy in con- 
Sinaia are related to age and to 
stances aa method of presenting in- 
mental th the concept. The develop- 
(1958) theory of Inhelder and Piaget 
grow atd that, as adolescents 
in ran. they develop greater facility 
Combinin Ine from the data at hand, in 
tion ae operations such as classifica- 
tanipilatine oe in formulating and 
Soning i ing propositions, and in rea- 
ion. Purth, hypothetico-deductive fash- 
Necessar her experimental evidence is 
cient red demonstrate that more effi- 
Evian: re operations are used by 
With Pe adolescents as compared 
Resteg py etrold adolescents, as sug- 
3 y these investigators. 

bed oe and Weiss (1953) have ex- 
9Sitive vhether negative instances of 
instances that transmit equal 
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information are equally effective in con- 
cept attainment. Concept attainment, 
they found, was more efficient with posi- 
tive instances than with negative in- 
stances. A pertinent question to be in- 
vestigated is whether this finding applies 
to concept attainment by adolescents 
under optimal conditions of presenting 
information. Cahill and Hovland (1960) 
have demonstrated that a simultaneous 
successive method for concept attain- 
ment was superior to a successive 
method, One of their measures, the per- 
ceptual error—a guess about the concept 
that is incompatible with the informa- 
tion in the current instance—was found 
to be highly correlated with concept at- 
tainment efficiency. 

In their concept attainment studies, 
Bruner, Goodnow, and Austin (1956) 
controlled the presentation of the in- 
stances and identified the instances as 
exemplars or nonexemplars of the con- 
cept. Their subjects guessed the concept 
after each instance and tended to follow 
ideal rules for maintaining or changing 
their guesses. Upon the basis of the 
Bruner et al. research, we have devel- 
oped two methods of examining the se- 
quence of guesses, the consistent and the 
ideal strategies. The consistent strategy 
indicates that the guess is maintained 
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or changed when the current instance 
is confirming or infirming. The ideal 
strategy is one where the guess is main- 
tained or changed in accordance with 
the information presented by the cur- 
rent and all previous instances. 

Perceptual error, consistent strategy, 
and ideal strategy, in that order, appear 
to be measures representing increasing 
maturity of cognitive operations. Per- 
ceptual error suggests an inability to 
deal with information given directly and 
perceptually. Consistent strategy shows 
an ability to deal with information by 
maintaining or changing guesses but 
without the systematic integration of 
previous information. Ideal strategy in- 
cludes the ability defined by the consist- 
ent strategy and the additional ability 
to integrate systematically previous 
information. 

The hypotheses are as follows: 


1. Twelve-year-old subjects will re- 
quire significantly more instances for 
concept attainment, will have signifi- 
cantly fewer consistent and ideal strate- 
gies, and will have significantly more 
perceptual errors than 14- and 16-year- 
old subjects. The 14- and the 16-year- 
old subjects will not differ significantly 
on these variables, 

2. Concept attainment on Positive in- 
stances will require significantly fewer 
instances, will have significantly more 
consistent and ideal strategies, and will 
have significantly fewer perceptual er- 
rors than concept attainment on negative 
instances presenting equal information. 


METHOD 


Subjects 


There were 40 boys at the 12-year level, 
40 boys at the 14-year level, and 40 boys at 
the 16-year level, making a total of 120 sub- 
jects. These boys were within 6 months of 
their birthdays. Subjects were from different 
public schools in western Massachusetts but 
were equally represented in the experimental 
groups to be described below. 
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Test Materials 


All the subjects were administered two piace 
tice problems and six experimental problems. 
Each problem consisted of 13 2 x 2 inch slike: 
After the first slide, each successive cycle g 
3 slides provided sufficient information to solve 
the problem. The problem was solved when 
the correct answer was offered twice consecU- 
tively without any subsequent incorrect re- 
sponses. P 

The first slide in each problem pene 
one positive instance of the concept, the focu 
instance. The remaining 12 slides for any 
problem included, on each slide, the fag 
instance and one other instance. For examp! 4 
on the slides of the positive ‘series, the ne 
instance and one other positive instance of i 
concept appeared. On the slides of the pe 
tive series, the focus instance and a negati 
instance were shown. ‘aie 

Each instance showed a combinjtion of zh 
attributes: (a) one of three forms (ET 
crosses, or squares), (b) one of three oa 
for the forms (red, black, or green), (¢) oo, 
three numbers of forms (one, two, or Bue ot 
and (d) one of three borders (one, OWI al 
three lines surrounding the forms). e 
examples of instances are: (a) one red Sae 
two borders; (b) two black crosses, three aei 
ders; (c) three green squares, one bor 
(d) two black circles, one border. 


an 
of the two series was three black squares oth 


two borders. The second problem o the 
positive and negative series required 3 ont 
subjects to discover that the concept W35 red 
form given the focus instance of omition® 
cross and two borders. The same con a P 
obtained for the other four experimental P 
lems (Yudin, 1962). rrect 
The instructions indicated that the m te 
concept in each problem was a single att! ack 
As mentioned above, the single attribute ine 
was the concept for the first problem an cept 
single attribute of one form was the T one 
for the second problem. Black crosses e Ter 
square could not be correct because the 
sponses contained two attributes. w the 
Equal information was presented z pro?” 
corresponding slides of the corresponding , phe 
lems in the positive and negative sere het 
second slide of the particular problem, W, ated 


; tog % . imin 
in the positive or negative series, eli 
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the same attribute. The third slide in this 
en climinated an additional but same 
ac For example, the second slide of the 
ie Pro ple, whether in the positive or nega- 
a ence climinated number; the third slide 
mee problem eliminated form. The experi- 
His z prab lenis; the instances contained on 
oe A: ides for each problem, and the attri- 
Yuck Iminated by each slide, are available in 
n (1962). 


dee 
Procedure 


expe 20, biedts were divided into four 
30 subjects i groups of 30 subjects each. The 
cluded 19 Bi apy one experimental group in- 
10 16-year Ai ag ee 10 14-year-olds, and 
all thé Tour o ds. The 12-year-old subjects in 
on intelige experimental groups were matched 
similarly i i and educational achievement; 
Bie a ne 14- and 16-year-old subjects in 
and ed groups were matched on intelligence 
we Ucational achievement. 
Tree experimental group was shown 
Problems Foie in their six experimental 
tive instan he second group was shown posi- 
Negative inet in the first three problems and 
the third Stances in the second three problems. 
given e solved the first three problems 
Probleme ive instances and the second three 
Problems a Positive instances. The six 
Negative ie ved by the fourth group contained 
he stances, 
pe org Were presented to groups of 
point n The attributes of the instances 
Were dem ed out and examples of instances 
Sven in AE, The full instructions are 
Problems Gdin (1962). The experimental 
Jects in ea Ter administered when the sub- 
Practice ach group had successfully solved the 
si exp Problems. All subjects solved the same 
e ee nenia] problems. 
be the ™mphasized that any one attribute could 
thi ipsa concept for any problem. By 
Set 4 p orton, we tried to break any possible 
Dractice may have been established by the 
Me; Problems or by the preceding experi- 
Sesion After each slide was ex- 
g O seconds, the subjects wrote their 
about the concept for that particular 
© subj Each slide was exposed only once. 
x bes co covered their guesses with a sheet 
fe t Provided by the experimenter. 
ince v uey of instances, we noted the 
We each Se the correct concept was offered 
ti te determi lem. The consistent strategies 
tes an ined by counting the number 0 
© hey 4 EVious guess was maintained when 
Mstance confirmed it or was change 


five 
Were 
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to accord with the new instance when it was 
infirmed. For the number of ideal strategies, 
we counted the number of guesses that was 
maintained or changed when indicated by the 
new instance and by all previous instances. 
A perceptual error was counted when the 
guess was not in accord with the information 
given by the immediately preceding slide. 


RESULTS 


The three age groups did not differ 
significantly on intelligence, all groups 
having an average IQ of 101 on the Otis 
Beta test. Tne four experimental groups 
did not differ significantly on age, intel- 
ligence, and school achievement. 


Age and Concept Attainment . (First 
Hypothesis) 

There was a significant difference in 
the number of instances required for 
concept attainment when the three age 
groups were compared (see Table 1). 
Further analysis by the Duncan range 
test (Edwards, 1960) showed that the 
12-year-old subjects required signifi- 
cantly more instances than either the 14- 
or 16-year-old subjects. The differences 
between the mean number of instances 
for the 12-year-old group (54.8) and 
the 14-year- (44.1) and the 16-year- 
(42.9) old groups were 10.7 and 11.9, 
respectively (see Table 2), These differ- 
ences exceeded the values of 7.2 and 7.7 
required for significance at the .05 level. 
The difference (1.2) between the 14- 
and 16-year-old subjects was not signifi- 
cant for instances. 

The results of the analysis of variance 
indicated that the main effect for the 
three age groups was significant on con- 
sistent strategies (see Table 1). Duncan 
range comparisons showed that the mean 
number of consistent strategies for the 
12-year-old group (56.3) was signifi- 
cantly less than the mean number for 


the 14-year-old group (61.7) and the 
mean number for the 16-year-old group 
ter than 


(63.4) where differences grea 
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TABLE 1 
ANALYSIS OF VARIANCE TABLE FOR DEPENDENT VARIABLES 
Number of Consistent Ideal Perceptual 
Source instances strategies strategies errors 
aj SSF SSF SSF ss FP 
a * 
Age (A) 2 3425, 5.9** 1099 6.2** 4838 8353** 500 ee 
Presentation (B) 3 527 6 189 PY 1067 1.2 an 30 
AxB 6 1763 10 327 6 2089 1.2 73 
Subjects/A x B 108 31499 9521 30601 6465 
Total 119 37215 11136 38596 8396 
* p= 05. 
as A =.01. 


4.2 and 4.4, respectively, are significant 
at the .05 level (see Table 2). There 
was no significant difference between 
14- and 16-year-old subjects on consist- 
ent strategies. 

On the variable of ideal strategies, 
there was a significant finding when the 
three age groups were compared (see 
Table 1). Duncan range comparisons 
revealed that the differences in ideal 
strategies of 11.7 and 14.7 between 12- 
year-old (31.0) and 14-year-old (42.7) 
subjects and 12-year-old and 16-year- 
old (45.7) subjects, respectively, ex- 
ceeded the differences necessary for sig- 
nificance at the .05 level (7.5 and 8.0) 
(see Table 2). No significant difference 
was found between the 14- and the 16- 
year-old subjects on ideal strategies, 

A significant finding for perceptual 
errors indicated that the three age 


The respective differences of 3.7 and i 
between the means for Dye 2- 
(11.5) and 14-year-olds (7,8) and ve 
year-olds and 16-year-olds (6.8) eit 
significant where differences of 3-3 ar 
3.5 are required for significance at dif- 
-05 level. There was no significant i 
ference between 14- and 16-year- 
subjects on perceptual error. of 
These results supported all ne 
the first hypothesis stating that 12-Y in- 
old subjects would be significantly k 
ferior on all measures to 14- an be 


year-old subjects who would not 
different. 


Jy- 
Method of Presentation (Second F 
pothesis) 


5 
TEE ifferenc®? 
There were no significant ae con 
on the number of instances, and © 


r 
x ia 5 " pe 
groups were different (see Table 1). sistent and ideal strategies wher 
TABLE 2 
MEANS AND STANDARD DEVIATIONS FOR Ace Groups on DEPENDENT VARIABLES 
„ceptu? 
Number of Consistent Ideal as 
Age group instances strategies strategies =p 
M SD M SD M SD M a 
7. 
54.8 16.4 56.3 9.8 31.0 14.5 11.5 7.5 \ 
12 years J 
14 TER 44.1 17.0 61.7 9.3 42.7 17.7 7.8 73 
16 years 42.9 152 634 73 487 138 68 
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TABLE 3 


MEANS Asp S T F T E 
2 ANS AND $ ss K ‘Ss 
STANDARD DEVIN IONS FOR Meriop OF PRESENTA’ ION ON DEPENDENT VARIABLES 


Method of Number of Consistent Ideal Perceptual 
presentation instances strategies strategies errors 
io 7 M SD M SD M SD M SD 

6 positiv FFA 
3 See . . 43.3 17.5 614 10.5 41.9 17.7 51 58 
3 TELAT, Plus 3 negative 48.8 17.7 612 92 . 379 178 8&3 9.2 
ative plus 3 positive 49.6 13.1 583 85 39.3 11.9 12.2 6.7 
61.0 7.1 40.1 15.6 89 73 


Negative 


46.3 16.1 


Se ai the positive series was com- 
Tables v h the negative series (see 
Sitaplesd a 3). On the variable of 
finding ( errors, there was a significant 
range hel T able 1). However, Duncan 
ber of alyses indicated that the num- 
Dhullive oni errors made on the 
cantly a (5.1) was not signif- 
Perceptual erent from the number of 
8.9. sen ee on the negative series 
Was pie able 3). A difference of 4.2 
05 lével kd for significance at the 
finding in aron fae eUn the significant 
due to th e analysis of variance was 
(12.2) a aope of perceptual errors 
Series, The e in the negative-positive 
confirmed. second hypothesis was not 
instances ; there were no differences on 
and on » Consistent and ideal strategies, 
tive Gin oe errors when the posi- 
ive series, as compared with the nega- 


Discussion 


‘Age 
and Concept Attainment 


by ae first hypothesis was supported 
old eo the 14- and the 16-year- 
to the oes were significantly superior 
tainm 2-year-old subjects in concept 
Ployeq ae efficiency. The strategies em- 
Subjects y the 14- and the 16-year-old 
the 2 Were also superior to those of 
grop, < ear-old subjects. The older 
oF i PS did not differ either in efficiency 
the „Strategies. These results confirm 
€scription of adolescent develop- 


ment advanced by Inhelder and Piaget 
(1958). They suggest that the stage of 
formal reasoning operations begins at 
about 12 years and reaches equilibrium 
at about 14-16 years of age. At these 
latter ages, Inhelder and Piaget (1958) 
indicate that subjects succeed more of- 
ten than 12-year-old subjects in solving 
problems demanding formal operations. 

In the conceptual problems of this re- 
search, two rules for transforming infor- 
mation were used. First, positive in- 
stances have the correct attribute and 
second, negative instances do not have 
the correct attribute. Subjects had to 
infer that any attribute that did not ap- 
pear in the positive instances would not 
be the correct concept. Some subjects 
had to make the additional inference 
that any attribute present in both focus 
and negative instances would not be the 
correct concept. In addition to these 
mental operations, the subjects had to 
remember the information supplied by 
the former instances. Our results then 
demonstrate that the 14- and the 16- 
year-old subjects are more capable in 
these mental operations than the 12- 
year-old subjects. 

The results of our strategy variables 
can help us to determine how the 12- 
year-old subjects were inferior to the 
14- and the 16-year-old subjects. Since 
the 12-year-old subjects made signifi- 
cantly more perceptual errors, it is evi- 
dent that they are less efficient than the 
14- and the 16-year-old subjects in deal- 
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ing with information given directly and 
perceptually. Twelve-year-old subjects 
were more liable to specify, as the cor- 
rect concept, an attribute that did not 
appear in the currently shown positive 
instance or to specify an attribute that 
did appear in the currently shown nega- 
tive instance. The proper application of 
the two rules for transforming informa- 
tion presented by positive and negative 
instances was more difficult for the 12- 
year-olds than for the 14- and the 16- 
year-olds. 

The 14- and the 16-year-old subjects 
showed significantly more consistent and 
ideal strategies than the 12-year-old 
subjects. Since the ideal strategies are 
counted as part of the consistent strate- 
gies and thus partially overlap, we will 
not separate these strategies in our dis- 
cussion. The following are the inferences 
based upon the results with consistent 
and ideal strategies: (a) the older sub- 
jects were more capable of remembering 
their previous guesses to check them 
with the current instances; (b) they 
more readily maintained their guesses 
when the current instances were con- 
firming or more readily changed them 
when the current instances were not 
confirming; (c) in the ideal strate- 
gies, they more readily maintained or 
changed these guesses to accord with all 
the previous instances, 
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The results did not support the second 
hypothesis and demonstrated that posi- 
tive or negative series, both presenting 
equal information, made very little dif- 
ference in the number of instances re- 
quired or in the strategies pursued for 
solution. In this experiment, unlike the 
Hovland and Weiss (1953) study, the 
negative and the positive instances were 
always presented with the focus (posi- 
tive) instance. For the subjects who 
worked with the negative series, the fo- 


cus instance was shown with each nega- 
tive instance on each slide. On each 
slide of the negative series, the subjects 
were thus aware of the attributes that 
could be correct (in the focus instance) 
and of the one attribute that was not 
correct (in the negative instance). This 
presentation of negative instances 1 
conjunction with the same focus instance 
may have resulted in relatively greate" 
efficiency of concept attainment. Possi- 
bly, Smoke’s (1932) original suggestion 
that negative instances might possibly 
contribute to efficiency of concept at 
tainment holds only when each negativ? 
instance is shown together with the ers 
positive instance of the concept. Began 
there were no redundant ir.stances K 
each cycle, a more systematic eia 
tion of incorrect attributes was pos 
without the added strain of dealing Bh e 
redundant information, Finally, ea 
attributes were the correct CONT 
possibly reducing the level of difficul- 
in assimilating negative informatio? 
that of positive information. 
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VERBAL STIMULI IN CONCEPT FORMATION: 


LEARNING BY DISCOVERY! 


M. C. WITTROCK 
University of Calijornia, Los Angeles 


The 292 college students were taught by 1 of 4 treatments to decipher 
transposition codes. The treatments were: rule and answer given, rule 
given and answer not given, rule not given and answer given, and rule 
and answer not given. A 2X2 linear hypothesis design was used to 
analyze the results. It was hypothesized and verified (p < .01) that 
when retention and transfer to similar examples are the criteria, giving 
rules is more effective than not giving rules. An “intermediate” amount 
of direction produced the greatest retention and transfer, but a “maxi- 
bale ti amount of direction produced the greatest initial learning. The 
minimum” direction group was least effective on initial learning, reten- 
tion, and transfer. It was concluded that under certain conditions, prac- 
tice and reinforcement for the guided development of concepts can affect 


, retention and transfer. 

TE recent research on learning by 
and y is reviewed by Ausubel (1961) 
The RA Kersh and Wittrock (1962). 
Sai S point of this paper is that there 
a of consistent, adequate ter- 
Ersa and labels to describe the 
Wop ex employed in these recent studies. 
R ee what is described as inter- 
(Kittel direction in one experiment 
Siew 1957) may be more directive 
rection at is described as maximum di- 
ment Cig 1956) in another experi- 
ery” t hat is described as a “discov- 
may emn (Gagné & Brown, 1961) 
rules a giving to the students the 
dons. he specific answers to the ques- 
f à and a second day’s rehearsal over 
rect ame material that was closely di- 

ed the first day. 
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Within a given experiment the same 
labels may be used to describe stimuli, 
hypothetical covert behavior of the 
learners, and their overt responses. For 
example, stimuli presented to learners 
are sometimes described as the rote 
treatment. The subjects are called the 
rote learners. The overt responses of 
these learners are dubbed the rote re- 
sponses. One is not surprised when in 
the Discussion section it is tautologically 
concluded that the rote learning group 
learned by rote. 

Until the important stimulus param- 
eters are known, the labels for the 
stimuli probably should be descriptive, 
e.g., rule given and answer given, with- 
out inferring a causal relationship be- 
tween stimuli and responses. The label 
discovery should probably not be used 
to describe stimuli or treatments be- 
cause it implies a relationship between 
stimuli and covert responses which may 
be unwarranted. It may also cause the 
reader to group together quite different 
treatments which should be kept sepa- 
rate. 

The second point of this paper con- 


e effects upon concept formation 


cerns th 
In research 


of the use of verbal stimuli. 
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on learning by discovery, the central 
question is whether or not the experi- 
menter’s presentation of verbal stimuli, 
e.g., rules, labels, and explanations, re- 
tards or facilitates the development of 
concepts. By adding a verbal stimulus 
to a class of stimulus objects, the mem- 
bers of the class may become more simi- 
lar to one another and less similar to 
stimuli outside the class. Concept for- 
mation, as measured by transfer, may 
be related to the meaning attached to 
these verbal stimuli. The recent re- 
search literature on learning by discov- 
ery has much to say about the effects of 
experimenter supplied verbal stimuli. 

The recent literature on discovery 
learning is examined below for the types 
of stimuli which were actually given to 
the learners. The labels used by the re- 
searchers to describe these stimuli were 
viewed with caution. The principles of 
reinforcement, practice, and extinction 
were applied to the responses which the 
stimuli probably produced. Much ap- 
parent inconsistency in the reported re- 
sults seems to disappear. 

When retention of learned rules or 
transfer of learned rules to new exam- 
ples is the criterion, giving rules appears 
to be more effective than either less di- 
rection (not giving rules) or more direc- 
tion (giving rules and giving answers to 
examples). Kittell’s (1957) intermedi- 
ate direction group, Kersh’s (1962) rote 
learning group, Craig’s (1956) directed 
group, Katona’s (1940, p. 36) under- 
standing group, and Forgus and 
Schwartz’ (1957) observer groups are 
all examples of giving of rules. Each of 
these groups was found to produce re- 
tention and transfer of learned rules as 
well as or better than any other group 
in the respective experiments. The 
Kersh (1958) experiment does not agree 
with the above studies. However, the 


2 or an excellent discussion of labeling sce 
Dollard and Miller (1950, Ch. 18). 


results were explained by Kersh as due 
to motivation and to postexperimental 
practice. 

In a rule given situation, the subjects 
are usually given simple (probably 
meaningful) rules and usually receive 
much practice and reinforcement for 
applying them to particular problems. 
This practice and reinforcement plus the 
distinctive verbal cues appear to en- 
hance retention and transfer as measure’ 
on tests which contain only stimuli to 
which the learned labels, concepts, and 
overt responses lead to positive transfer. 
The subjects cannot discover the rule 
but they can discover how to apply the 
rule. The practice of applying the rule 
may also allow them to extinguish the 
associated but incorrect responses which 
they have in their repertoire. 

Whenever a rule given and answer 
given group was included in the abot 
experiments (Kersh, 1962, directe, 
learning group; Kittell, 1957, mazi 
mum direction group), transfer an 
retention for this group was inferior 
to the rule given grovp. Haslerud an 
Meyers (1958), however, found no dit- 
ference on a transfer test between the 
“specific directions given” items, 2” 
the “no directions given” items. pus 
their experimental design may have ar 
taminated the treatments. Each ee 
was given equal practice on each of ie 
two experimental conditions. If pract!® 
on discovering concepts tends to 8° 
eralize to related items, one would wl 
pect that their treatments were C° 
taminated. he 

Giving the specific answers and 
rules may retard retention and trans 
because there is insufficient practice cae 
reinforcement for overtly applying = 
cepts. There is also little opportum! s 
for strongly learned and strongly A 
ciated incorrect responses to be eli 
and to undergo extinction. , 

Tf the criterion is initial learning 


n- 
x- 


of 4 
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limited number of specific answers 
rather than the transfer or retention of 
What has been learned, the most highly 
directed groups, i.e., the rule and answer 
a groups, do as well as or better than 
ee groups (Haslerud & Meyers, 
Seo ittell, 1957). Where short-term 
Tieso ry of a few associations is sampled, 
tee e that practice and reinforcement 
Sonne applied more effectively to the 
Jo: th pe of these associations than 
what i evelopment of concepts. Again 
tote is practiced and reinforced appears 
what is learned. 

net of oe above studies included a 
titi i o the effects of the treatments 
fe pied of the learners to pro- 
‘is Bice | to apply alternative rules, to 
Eta thinking, to learn how to 
teria ks to create, etc. With these cri- 
tee a rg groups which are given prac- 
ri n r reinforcement for the develop- 
Sider : tyre alternative and higher 
should re: ie., the discovery groups, 
if the e the most effective. However, 
rather N i results in extinction 
teinforceme, in regular or intermittent 
effective. nent, these groups may not be 
i a what little pertinent re- 
to su ere is in the literature does tend 
is he Pa these statements, the support 
found ‘ion Gagné and Brown (1961) 
vel at their discovery and guided 
rule pie groups were superior to their 
new be example group at developing 
given ules. ‘The former two groups were 
tiie at deriving rules but were 
tule. ced for deriving only the correct 
may tough giving rules and answers 
thus Provide many correct answers and 
Ype reinforcement, the nature of this 
With reinforcer must be compared 
e nature of the reinforcer ob- 


tai 
effort from discovery. Independent 
of -ÈS highly valued by many members 


o ; : 
ur society. By attempting several 


tes 
Ons, 
Ponses before producing a correct or 


divergent response, which is reinforced, 
the socially valued motive of independ- 
ent effort is intermittently reinforced. 
Assuming a learner history of reinforce- 
ment for independent effort, persistent 
behavior may be produced. It would 
also be expected that the less directed 
techniques would have higher affectivity 
loadings (either positive or negative) 
than the more directed techniques. 

From the above summary of research, 
it was predicted that when giving or not 
giving rules and answers to examples are 
compared: 

1. On initial learning of specific re- 
sponses, giving rules is more effective 
than not giving rules. Giving both an- 
swers and rules is more effective than 
giving either the answers or the rules. 
Giving neither rules nor answers is least 
effective. 

2. On retention and/or transfer to 
new and similar examples, giving of 
rules is more effective than not giving 
rules. Giving of rules is more effective 
than giving both rules and answers or 
giving neither rules nor answers. 


METHOD 


Subjects 


The subjects were 292 University of Cali- 
Los Angeles, students from two upper 
sychology classes which 
were taught by the author. Participation of the 
subjects in the experiment was mandatory for 
all students enrolled in the classes and was 
part of the laboratory requirement of the 
course. There were 39 males and 253 females. 
Table 1 presents some information about the 


subjects. 


fornia, 
division educational p: 


Experimental Design 


The subjects were individually assigned at 
random to the eight experimental conditions. 
A 2x2x2 factorial, linear hypothesis design 
(Kempthorne, 1952, pP- 38-67) was used. The 
three factors were: (a) Rule—given or not 
given; (b) Order—example first, rule second, 
or rule first, example second; and (c) Answer— 
given or not given. The order factor was de- 
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TABLE 1 


MEANS AND STANDARD DEVIATIONS FoR THE AGE IN YEARS, VERBAL SCORE, AND NUMBER 
ABILITY MEASURES OF THE TREATMENT GROUPS 


Cooperative 


Arithmetic 
English Concepts 
Group Age score score 
M SD ÄI SD M SD 
Rule given and answer given i 
cane N = 81) 22.05 5.31 61.59 6.52 32.60 7.75 
Rule given and answer not M 
given (RgAng; N = 75) 20.99 3.54 60.82 6.27 32.49 7.72 
Rule not given and answer 3 ago 
given (RagAg; N = 69) 21.01 3.44 62.49 6.81 3.22 i 
Rule not given and answer not 3 
given (RasAag; N = 67) 21.76 407 62.33 6.78 32.64 T 
al 
Note.—The Cooperative English Test, Form S (Cooperative Test Division ebi 


ability. A measure of number ability was obtai 
fornia, Los Angeles, product which 


signed only as a control for order of initial 
presentation of stimuli. The programed book- 
lets allowed the subjects to advance to later 
pages or to return to earlier pages. All pos- 
sible combinations of these three factors pro- 
duced four experimental treatments (each with 
two different orders) which were designed to 
vary in amount of direction from the giving 
of examples with both rules and answers to 
the giving of examples without rules or an- 


swers. The four experimental treatments are 
listed below. 


. Rule given, answer given (RgA,) 

. Rule given, answer not given (RgAng) 

. Rule not given, answer given (RagAg) 

. Rule not given, answer not given (RugAng) 


wre 


+ 


Materials 


Programed booklets presented the learning 
and initial test materials to all subjects. The 
booklets were of 24 weight, grey, opaque paper 
and were 8% inches wide, 334 inches high, 
and 37 pages in length. The booklets for all 
the treatments were identical to one another 
in appearance. Pages 1 and 2 presented gen- 
eral directions on the content and use of the 
booklet. Pages 3, 4, and 5 presented, in vari- 
ous sequences depending upon the experimental 
treatment, appropriate directions, a rule, a 
worked example of the rule, and a “to be 
worked” example of the tule. Page 6 sum- 
marized the specific, detailed instructions for 
the respective experimental treatment. 


ned from the Arithmetic 
has not been published. 


re asure verba 
1 1950), was used to measure Vgl- 
Concepts Test, a University 


The remaining 31 pages, with the exception 
of the last page, contained the learning aa 
rial and the initial test. These 30 pags Be 
divided into 10 series of 3 pages cacl. jo 
set of 3 pages was considered as a brief Ps 
gram and consisted of a page where a rule be 
given or was to be derived by the subject fe 
a page where an enciphered sentence (an ved 
ample of the rule) was presented eo 
cither by the same sentence deciphered tence 
swered) or by a space in which the Al “phe 
was to be deciphered by the subject. d to 
order of these above 2 pages was ee 
present the stimuli in one of two di ules, 
orders. The subjects who were given " 
answers, or both were required to copy jded 
respective rules and answers in spaces Prov’ an 
in the learning booklets. This was done iP fis 
attempt to hold constant across fren es 
overt practice on writing the rules and ans) wa 
The third page of each set of 3 pages nted 
identical for all treatment groups and Be ere 
another enciphered sentence to be deciP was 
by the subject. This criterion sengene was 
also always an example of the rule whic 
appropriate for the example from 1 a 
2 immediately preceeding pages. The 
criterion sentences comprised the learning ere 
The 10 rules, each with its two examples 
arranged in random order in the booklets. 
same 20 enciphered sentences (examples) 5 
Presented to all subjects of all trea 
groups. 

Knowledge of correct results was a 
vided to the subjects. This was intenti 


we 
ent 


ro" 
ally 
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to avoid contaminating across treatment 
fig Ps the reinforcement and feedback which 
ae subjects obtained when they correctly de- 
ciphered sentences. g 
oun retention test consisted of 24 
Sbi sentences to be deciphered by the 
sie ese es sentences were chosen to sam- 
eee nition and transfer. Eight of the sen- 
3 web identical to sentences’ presented 
Tiere ay Sarlier: Another 8 of the sentences 
sotd aa examples of 8 of the 10 rules pre- 
examples ae Eight of the sentences were new 
i eda a transposition coding rules. 
terials w es rom the learning and testing ma- 
cluding sits 18 letters long. The rules, in- 
ee des Hose of the transfer tests, were rules 
1943), i esas transposition codes (Smith, 
Ware eee when properly decoded, 
thie ag ae os sentences and were sensible. 
order. Be ences were arranged in random 
tence, aa mples of a rule, an enciphered sen- 
ie aan Correctly deciphered sentence from 
Rule—ine es appear below. 
two letto erchange the first two and the last 
rs of each group of letters with each 


Other: 
Cr; then separate into words. 


Enciphered sentence— 

HRNTME DIGEON RKPAHE 
Deciphered sentence— 

MEN THRONGED THE PARK 


Procedure 


T] x 

ue apart reported to the laboratory in 

®Propriate o or less and were given booklets 

The qifen t their experimental treatments. 
erent treatments existed simultaneously 


in the same room. The subjects worked indi- 
vidually. They were told to read the instruc- 
tions carefully and that there was no time 
limit for completing the exercise. In addition, 
they were told that they must attempt each 
item, and that they should immediately return 
the booklet after completing it. 

The posttest was given 3 weeks after the 
learning task. Again, the subjects were al- 
lowed as much time as they required to com- 
plete the test. Each test item was scored as 
correct if 16 or more of the 18 letters were 
correct. If 15 or fewer letters were correct, 
no credit was given for the item. 

Each subject was told at the start of the 
experiment that he would be informed of his 
own results and of the results of the experi- 
ment. A personal letter was mailed as prom- 


ised. 


RESULTS 


Because some subjects did not return 
on the appointed day for the retention 
test, the general linear hypothesis model 
(Kempthorne, 1952, pp. 38-67), a more 
general model than analysis of variance, 
was used to avoid arbitrarily eliminating 
subjects to equalize the cell » and to ob- 
tain accurate measures of the primary 
and interactional effects of the three 
variables. Homogeneity of variance and 
normality of distribution were assumed 
for each of the eight treatment groups 


TABLE 2 


Summary or THE F Ratios FOR TH 


E LEARNING, RETENTION, AND TRANSFER TESTS 


Scores AND TIMES 


E —— TETE feat 3-week retention and transfer tests 

si Transfer Combined 

va Transf to new retention 

Variables z Tranter ulesand Combined and Time to 
= 1 i Ame so Retention examples examples transfer transfer, perform 
ire earning learn Reter n z aule uaia, 

ul ee es Aen ee: Sk Re Pa -— 
Oraa, 4) 400.748 ILII 3.94% = 10.41** 9.84** 215 
Answy (B) 04 69 2.92 68 2.57 60 02 
Avy (C) a3n7peee  ggopt* 284 1.16 as 98 25 416 
Ave 38 9.37** 01 .03 28 10 97 73 
ax c is7a7eee gagat | 17.57*** 7.29% 12.04*** 11.36%" 8.78** 3.25 
Ax 11 ` o6 1.34 79 145 162 137 05 
Saxe a : 34 48 03 26 ‘ols 44 

es 1.23 3.40 re as 6 e 


df = 1/284. 
» df = 1/284. 
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for each criterion, except for the learn- 
ing test score, after appropriate F tests 
and graphs of frequency distributions 
evidenced no reason to discredit the as- 
sumptions. For the learning test, the 
violation of the assumptions required 
that the reported significance level be 
examined carefully. However, with an 
F of 490.74 (see Table 2) and with the 
sizable increase in the mean and de- 
crease in the variance for the rule given 
groups compared with the rule not given 
groups, there is little doubt that these 
results are dependable. Tables 2 and 3 
present a summary of the results of the 
learning test and of the 3-week retention 
and transfer tests. Since the Order fac- 
tor injected no significant amount of 
variance into any of the criteria, except 
an interactional effect for time to learn, 
the Order factor was ignored in the 
analysis of the data. 


Learning Test 


From Table 2, the Rule factor pro- 
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duced a statistically dependable effect 
upon learning (F=490.74, p < .001). AS 
predicted in Hypothesis 1, the groups 
that were given the rule correctly de- 
coded more sentences than did the 
groups that were not given the rule (see 
Table 3). 

Hypothesis 1 also stated that the eX 
perimental groups would rank from hig 
to low, R,A, first, RyAng OF Rais 
second, and RyyAng third. If the RyAng 
and RagA, groups are combined into 2? 
“intermediate direction” group (see vd 
ble 3), the predicted rank order 15 ki 
tained. However, from Table 3, 
R,Ay group and the RyAug group Yer 
not dependably different from vee 
other and each was dependably bet! ch 
(p < .01) than the RngAg group, een 
in turn was dependably better (= We 
p < 01) than the RugAng grouP- ded 
groups that were given the deco i 
examples correctly deciphered more a 
amples than did the groups that w 


TABLE 3 


TREATMENT GROUP MEANS AND STANDARD DEVIATIONS FOR THE LEARNING AND 
3-WEEK RETENTION AND TRANSFER TEST SCORES AND FOR THE TIME 
IN MINUTES TO LEARN AND TO PERFORM 


— CEE = ——— A 
fanton Learning test 3-week retention and transfer tests x 
aa te 
‘ten Com; 
Treatment groups Trans- rules bined wean lO 
, ferto and Com- reteny Tinom 
Daming HES? Ra aae new ae baa, Pade, P 
f i t pis i i E3 14243 oy 
Rule given and answer given 9.52 46.64 533 4.16 “3.27 7.43 12.74 $00 
(RAs; N = 81) 8 BS 17 17 17 29 43 ogs 
Rule given and answer not 9.73 5112 $83 493 4.04 8.99 1481 458 
given (RyAne; N = 75) 6 M8 15 17 17 30 4 gg 38 
Rule not given and answer 759 66.84 5.29 403 357 759 1286 998 
given (RaogAg; N = 69) 2.6 216 18 17 16 30 43 g2 
Combined groups (RsAws+ 8.71 58.65 s57 4s0o 38i 832 1388 394 
RagAs; N = 144) 21 200 17 18 17 3å a gi} 
ule not given and answer not 2.76 103.55 412 64 10 5.4 
ar (RngAne; N = 67) 22 3911.8 vy it a 4.6 Be 


Note.—There were 10 items on the learning test 


— riet 
t h + and on the 3-week retenti transfer te the Por 
a total of 24 items, with 8 items on each of the 3 s e 3-week retention and thë ib 


ive number of items on the test. All columns, 
eet items. The second and the last columns, 


3 as 
ubtests. Possible score on each of these tests čan num 
except the second and the last columns, list ™ 

which are labeled Time, list time in minutes. 
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given the examples which w 

ee p ich were not 
gei was a dependable interaction 
ri the Rule and the Answer fac- 
ake (F=157.47, p < .001). When the 
an Was not given, giving the answer 
tae learning. When the vule was 
D the answer did not enhance 

7 4 

oe time to learn was compared, 
Sark api group required significantly 
oe ik Ime (p < .01) to learn than any 
ln other groups. The odd-even, 
~Pearman-Brown coefficient of reliabil- 


Ity fo . 
r all experimental treatments com- 
ned was .92, 


Retentj 
tention and Transfer Test 


ie 2, the Rule factor pro- 
e tests gin significant effects on 
Predicted > retention and transfer. As 
Bie ar also in Hypothesis 2, the 
‘3.01 oup was dependably better 
and the aS .01) than the RgAg group 
On the com ng group (t=5.52; p < .01) 
transfer aapinen test of retention and 
R ypothesis 2 was supported. 
tion scor ngng group had a higher reten- 
tee gr e than learning score. The other 
than ha | retention scores were lower 
Bene learning scores (there were 
the. on the learning test but only 8 
Neer on test). This “postex- 
Btoups ee gain for minimally directed 
È Me as been found before (Haslerud 
i sie 1958; Kersh, 1958). 
Or Pet iar between the Rule fac- 
the ae the Answer factor discussed on 
tically rning test above was also statis- 
transf significant on the retention and 
the z tests (see Table 2). However, 
tically Swer factor, which was statis- 
Wag not o ficant on the learning test, 
'etentig Statistically significant on the 
tests, n or on either of the transfer 
wer m Seems that giving specific an- 
°t rule Proved initial scores whether or 
S were given, but improved re- 


tention and transfer scores only when 
rules were not also given. When time to 
perform was considered, the groups 
given answers required significantly less 
time (p < .05) than did the groups not 
given answers. 

The odd-even, Spearman-Brown reli- 
ability coefficient for all treatments com- 
bined was .65 for the retention test, .77 
for the transfer tests, and .82 for the 
combined retention and transfer tests. 


DISCUSSION 


Before the results are discussed, sev- 
eral limitations to their generality should 
be mentioned. The subjects were college 
students. The experimental treatments 
must have interacted with the subjects’ 
strategies for learning information. The 
type of verbal stimuli which was studied 
was limited. The rules were all simple 
ones which did not need explanations or 
derivations to make them meaningful. 
This study did not sample ability to do 
divergent thinking or ability to transfer 
to quite different situations, e.g., to de- 
cipher substitution codes. It is probable 
that less directed procedures are most 
effective for these criteria. 

The results of this study are in very 
close agreement with the interpretation 
of recent research presented in the in- 
troduction. When the criterion is initial 
learning of a few responses, explicit and 
detailed direction seems to be most ef- 
fective and efficient. When the criteria 
are retention and transfer, some inter- 
mediate amount of direction seems to 
produce the best results. 

If a criterion of percentage of reten- 
tion were used, the results of this study 
would be interpreted to agree with those 
of Haslerud and Meyers (1958) who did 
use that criterion. Far different conclu- 
sions from those given above would be 
presented because only the RagAng 8roUP 
produced an increase in score from the 
learning test to the retention test. It is 
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extremely important that one relate his 
results to the criterion which was sam- 


pled. , 
The study implies that under certain 
conditions meaningful direction can 


supply distinctive verbal cues which can 
increase the probability that the learner 
responds in the directed fashion and, 
therefore, can decrease the probability 
that he responds in other fashions. This 
verbal direction can be used to enhance 
transfer by eliminating alternative re- 
sponses which produce negative transfer 
and by including alternative responses 
which produce positive transfer. It ap- 
pears that the direction should match 
the criteria. If the direction provides 
explicit practice and reinforcement for 
responses across the range of positive 
stimuli and allows the responses outside 
this range to be elicited and to be extin- 
guished, positive transfer may be en- 
hanced. To refrain from introducing 
labels for concepts when learners have 
adequate backgrounds to make these 
labels meaningful seems to be a vain at- 
tempt to enhance transfer which instead 
probably only reduces it and wastes time 
during acquisition. 

Meaningful terminology and labels, in 
addition to the important but general 
term “reinforcing stimuli,” are much 
needed to describe and to classify the 
stimulus variables employed in research 
on discovery learning. A sophisticated 
theory of concept formation is needed 
not only to supply these terms and la- 
bels but also to account for the phe- 
nomena observed in research on learning 
by discovery. 
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CONC 7 page 

oe AL DISCOVERY AND CONTROL ON A 

ras IAL PART-WHOLE TASK AS A FUNCTION 
AGE, INTELLIGENCE, AND LANGUAGE’ 
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ok ide ig nonverbal conceptual behavior in relation to age, 
ear Raa an bp an normative data for hearing children and 
cP ihe tack n, age 6-10 and 14, were collected. The major requirement 
nana i sk was a consistent control of choice behavior by the discovered 

ciple of part-whole. In spite of moderate correlations between 


IQ a for i i 
Q and performance, improvement with age was only gradual, Just as 
f Ss. the kind of verbaliza- 


ormance. 
eptual control was 
lly associated with 


om wi verbal experience did not handicap dea 
ak ky ter the task was found to be uncorrelated with perf 

he basis of these findings a construct of conc! 
postulated as being related to IQ but only minimal 


age or language. 

sitter ret investigated children’s 
ina nonve ay the part-whole concept 
is meant 7 al situation. By part-whole 
objects he relationship of two visual 
monly p n that one object can com- 
button is Sale part of the other. Thus 
at and foes i part of a coat while 

Other Fein although related to each 
relation ‘Cans exemplify a_part-whole 
Concept w wo aspects of mastery of the 
Principle ere observed: discovery of the 
accordi and consistent choice behavior 

h ng to the discovered principle. 

ht pe el a was designed to shed 
Conceptual $ relation between nonverbal 
'ariables: behavior and three important 
anguage Nong intelligence, and verbal 
Ver an a Normative data were collected 
the Bate span from 6 to 14 years, and 
ormance of children with high 
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and low intelligence within and between 


each age group was analyzed. In this 
way it was possible to evaluate the con- 
struct of IQ and MA in relation to this 
nonverbal task. Verbal language in this 
context refers to the ordinary language 
of one’s society, i.e., spoken English, as 
part and parcel of a growing child’s en- 
vironment and as possibly being em- 
ployed internally during the solution of 
a task. The influence of language was 
manipulated by comparing deaf and 
hearing children at each age level and 
by asking hearing children to verbalize 
the principle by which they operated. 
Apart from clarifying the influence of 
verbal experience on cognitive behavior, 
a comparison of deaf and hearing chil- 
dren contributes towards the under- 
standing of the cognitive functioning of 
deaf children. General vague statements 
about deaf persons’ deficits in abstract 
ability have been only recently subjected 
to scientific inquiry (Furth, 1961, 1963; 
Kates, Kates, Michael, & Walsh, 1961). 
Many investigators have tacitly assumed 
that verbal language is an important or 
indispensable ingredient of general cog- 
nitive development and that the inferior 
performance of deaf people on various 
tasks is a direct reflection of their Jan- 
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guage deficiency. In such cases it would 
appear scientifically more appropriate to 
analyze the task variables in relation to 
the deaf child’s total experience rather 
than to make unwarranted claims about 
the latter’s deficiency in abstract think- 
ing (Furth, in press; Milgram & Furth, 
1962). From a preliminary analysis of 
the present task it was expected that no 
differences would emerge in the perform- 
ance of deaf and hearing children. 


METHOD 
Subjects 


The hearing children came from Grades 1-5 
and Grade 10 of a parochial school system. 
They were divided into six groups on the basis 
of age, 6-10 and 14 years. The number of 
children in each age group was 36, 51, 87, 59, 
62, and 100, respectively, The deaf children 
were taken from the Maryland State School, 
a Baltimore day school, and the New York 
School for the Deaf, The respective number’ 
for each age group was 16, 11, 14, 20, 13, 


and 41. In all groups the sexes were about 
evenly divided. 


FURTH 


Task 


Twenty sets of five pictures cach were drawn 
with black pencil on 3x5 inch white cards 
by a commercial artist. In each set two draw- 
ings illustrated the part-whole relationship and 
their choice was considered “correct.” Several 
other reasonable combinations according to 
class, function, or experiential association were 
Present on each set. These served as controls 
for the specificity of the attained principle by 
Providing the pull of strong misleading per 
ceptual associations. Table 1 presents the series 
of pictures shown with the “whole-part” pair 
at the beginning of cach set. 


Procedure 


Each child was seen individually in a small 
private room. The experimenter placed the 
five pictures of Set 1 on the table before the 
subject in a random order so as to discourage 
formation of position habits. Without addi- 
tional explanation the child was told by words 
oF gestures to pick up or point to two of the 
five pictures, During Learning Trials 1-13 ê 


. Correct choice was reinforced by the experi- 


menter’s nodding or saying “good.” If ae 
child failed, the experimenter said. “no” a? 
Pointed to the correct pair, On Trials 14-20 7° 


correction or reinforcement was given. Anan 
TABLE 1 
STIMULUS SERIES 
Set Picture 
1 Pot Lid Basket 
0 a ate 
2 Bicycle Wheel Shoes = abit 
3 Flashlight Bulb Umbrella Fire Ball 
4 House Chimney Tree Jar Tent 
: an á Leaf Boy Flower Cow 
é a Steeple Man House Factory 
ae n Firehat Police Ambulance Fire 
g ee Handlebars Girl Car Wagon 
etter Stamp Maill k : il 
10 a Tusk Fish iii hay et 
i Belt Wing Fish Balloon Airplane 
g jee Buckle Sweater Rope Pants 
iB eae pub Tree Fire Sun 
15 Clock Chock bands on Hoyr L 
16 Lesbos Nipple an wdi eede 
n 
i ; Paca Ear i Sad Bed. i 
7 oE Shoct Eyeglasses Book Hat 
20 Book Pa oo nent Slippers — 
ge Pencil Briefcase Pen 
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TABLE 2 
Mean Error or Groups As A FUNCTION OF AGE 


A m 
Set Grp ge level 
6 7 8 9 10 14 
Lerins (139 Hearing 3.25 2.02 2.32 164 ° 1.24 1 
Deaf 3.87 2.36 2.64 1.55 1.62 83 
Criterion (14-20) Hearing 3.92 4.12 3.45 3.44 2.42 2.21 
7 Deaf 4.12 4.00 3.64 3.00 2.92 2.09 
Total (2-20) Hearing 7.17 6.14 5.77 08 3.58 3.12 
Deaf 00 6.36 6.28 4.55 4.54 2.93 
-— 


fe Just trial the hearing subject was asked to 
kr lize, if possible, the principle of his choice 
Raine a On a separate day afterwards all 
form g subjects were given the appropriate 
Sin of the Otis Intelligence Group Test. 

ce results on the Otis test for first graders 


ar 
— Me some others were unsatisfactory, the 
mber for the part-whole task and 1Q is 


Not equal in all cases. 


RESULTS 


n t seemed appropriate to separate 
on ors on the learning trials from errors 
tot: ce trials as well as to analyze 
dist errors. Performance on Set 1 was 
y regarded as being entirely due to 
nŠ ssing. Table 2 summarizes average 
Hoe for the hearing and deaf groups at 
X age levels. 
Ph haar by sex showed no appre- 
i ate differences, hence the sex variable 
S, disregarded in the analysis of data. 
irst the performance of the hearing 
PA was subjected to an analysis of 
oa and for this purpose 36 subjects 
re randomly selected from each age 
8toup, The mean error score of these 
Stoups differed only a little from the one 
ased on all subjects as given in Table 2. 
va ghy significant Fs emerged for age 
teat with learning (9.59); criterion 
eee and total score (12.09). Dun- 
ns multiple-range test (Li, 1957, 
D. 238) for learning trials showed that 


the 6-year group differed from all others 
and that Groups 7-10 and Groups 9-14 
did not differ reliably. For the criterion 
trials Duncan’s test revealed a very 
gradual decrease of errors with age by 
constant overlapping of three age levels 
except for the 14-year group which only 
overlapped with the 10-year group. For 
total error score the 14-year group was 
found to differ significantly from all 
other ages, while the 6- and 7-year 
groups and the 8-10 year groups did 
not differ reliably from each other. As 
an overall picture then there was a 
gradual significant improvement of part- 
whole performance with age; on the 
learning part a marked decrease of er- 
rors took place at age 7, and for the 
criterion part a similar improvement at 
age 10. 

The performance of the deaf children 
as depicted in Table 2 was notably simi- 
Jar to that of their hearing controls. Not 
1 of the 18 possible comparisons ap- 
proached significance by a ¢ test. 

To evaluate the performance of above 
and below average subjects, 10 subjects 
each were randomly selected at five age 
groups from all subjects with IQs be- 
tween 105 and 115 and with IQs be- 
tween 85 and 95. Table 3 gives the 
pertinent data which are in essential 
agreement with the ones reported for 
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TABLE 3 
Mean ERROR as a FUNCTION or AGE AND IQ es 
5 E Age = 
14 
Set 1Q 7 F ð 10 
ers -— — ——— ———_ F 
High 1.2 8 12 14 Re 
Learning (2-13) Lows 48 is 13 
1 
High 3.5 2.2 2.7 14 3.0 
Criterion (14-20) Low. 5 45 to Pe : 
5 2. 
High 4.7 3.0 3.9 2.8 45 
Total (2-20) Low 91 s3 sE Fi 5 


the total sample, Learning, criterion, 
and total errors were analyzed and con- 
sistently the greater part of the variance 
had its source in IQ, with F ratios ex- 
ceeding 20 in all cases, In contrast the 
overall F for age, although significant 
beyond .01, was only 4.51 for learning, 
5.74 for criterion, and 6.65 for total 
errors. Apparently then there was a 
greater degree of association between IQ 
and error than between age an 
the part-whole task. Such a conclusion 
is substantiated by correlations þe- 
tween IQ and criterion, based on all the 
subjects of an age group which were 
33, .51, .29, 39, and .43 for ages 7, 8, 
9, 10, and 14, respectively, These mod- 
erate correlations reported differ signifi- 
cantly from zero, i 

The verbalizations of the older 
only were analyzed si 
jority of even the 
said “I can’t tell.” 
and 15 years old, 22 Save the lat- 
ter answer; 46 said something like 
“go together, belong”: 30 mentioned 
“needed” or “repeated”; and only 17 
used the correct verbal description 
“part.” Table 3 shows the number of 
errors of these four groups on the seven 
criterion trials. The order of index as- 
sociation (0; Senders, 1958, p. 130 
between verbalization and performance 
is a weak, but significant o of «LS; 


d error on 


Finally, types of errors were analyzed 
to discover possible age-charactensti 
choices, Thus on Set 17 an incorrec 
choice of man and coat or on Set 19 - 
choice of a sock and feet was made pi 
quently but 14- and 8-year-old nage 
erred with about similar frequency. 
general, then, all age groups and ieee 
and deaf subjects were subject to simita 
kinds of errors, 


Discussion 


While it is not surprising that a 
formance on the task improved with 
age, the slowness of the decrease in a 
rors is quite striking, Fourteen-year-0 7 
children failed to act in a logically po 
sistent way nor have they reached H 
stage where they can be said to atas” 
the present task in a qualitatively differ 
ent way from much younger children- 


TABLE 4 


oN 
FREQUENCY OF Errors ox SEVEN CRITERI 
TRIALS As RELATED TO Type OF 


VERBALIZATION n 
—— Se 
a Errors se 
Verbalization ——+___ a 

o 1 2 & g 
7 gs pet E 
Part 5 5 5 4 0 e 
Needed t 4 6 g 4 3 
Go together 5 3 10 16 9 2 
Can't tell 2 6 6 § 1 
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E woma appear that the major require- 
the {Ok thie task, besides discovering 
the oe apa choice, was to adhere to 
i bs gaa in spite of competing pulls 
With misleading directions. In line 
ose reported results on a 
, 1937) task (Schooley & Hartman, 
little ee the younger children had 
sls ante in discovering the prin- 
done i relatively few errors were made 
iring learning trials. 
pi apial control would seem an ap- 
of ee e torm for describing the nature 
of sn task. Luria (1961) spoke 
above rs ional of behavior and the 
Luria’s a ENE NS purposely related to 
ite Ad e Luria’s procedure, how- 
he rea rad oyed verbal instructions and 
ing the hea his conclusion by observ- 
on beh influence of these instructions 
Was no lle The present procedure 
trl ge and control of behavior 
Verbal | n be largely independent of 
Pears behavior. Such an inference ap- 
a grab whether one thinks of 
Meriena in terms of general verbal ex- 
and see SE Ha specifically facilitating 
childr ntrolling a particular task. Deaf 
o Aa are certainly minimally exposed 
Derfor bal experience and were found to 
Deers m very much like their hearing 
hand, Hearing children, on the other 
hey peng ag very little, and where 
o d so, the relation of verbalization 
A ai orinance was tenuous at best. 
suecan ahisi verbalized wrongly and 
Contr ed fairly consistently and, in 
ba at of the 17 subjects who ver- 
ently correctly, only 5 made consist- 
TS a choices on Criterion Trials 
Serve | Tt would be instructive to ob- 
al More directly the influence of ver- 
control by asking children verbally 
mee their choice on the part-whole 
Cept. 
cl he curious fact of c 
T ‘ition of part-whole performance with 
ga not with age, deserves some at- 
ion. A look at Table 2 will show 


a moderate Cor- 


that the criterion score for ages 6-9 in- 
clusive differed but little, yet correla- 
tions ranging from .29 to .51 were re- 
ported between error and IQ. At each 
age level as depicted in Table 3 the 
lower IQ group made significantly more 
errors than the higher group. A com- 
parison of the rather similar perform- 
ance of the high 7-year and the low 
14-year groups illustrates that our tra- 
ditional MA is an inappropriate concept 
in connection with the present task. The 
average MA of the lower 14-year group 
was about 12-7 years with a mean er- 
ror of 4.5 on the part-whole task. Ac- 
cording to Table 2 a total error score of 
4.5 corresponds to an age level of 9 or 
10 which is 3 years below the MA level 
of the below average 14-year subjects. 

While such points show that the pres- 
ent task would be unsuitable for a tra- 
ditional kind of ability test, it does seem 
to highlight a difference between below 
and above average mental ability which 
may have much to do with what is here 
called conceptual control. The more in- 
telligent child may be the one who, re- 
gardless of relatively great age differ- 
ences, can control his behavior more 
consistently and more successfully by 
means of conceptual principles. 

The remarkable similarity of deaf 
and hearing groups’ performance demon- 
strated that deaf children were not in- 
ferior in discovery of the part-whole 
concept nor in conceptually controlled 
behavior. Both findings appear contrary 
to older generalizations but are well in 
accord with more recent findings (Kates. 
Yudin, & Tiffany. 1962). Since none 
of the three public schools from which 
deaf subjects were drawn pursue a selec- 
tive policy with respect to admission, 
there is no ground for the assumption 
that the deaf subjects represent an above 
average sample, While it is readily ad- 
mitted that the concept of part-whole 
by itself is of no particularly high order 
of abstraction, concept controlled be- 
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havior, however, would appear to be 
part of what Goldstein and Scheerer 
(1941) called the abstract attitude. 
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IMPLICIT REINFORCEMENT OF RESPONSES 


LEE SECHREST 


Northwestern University 


The question under examination was the effect on children working in 
pairs of either positive or negative reinforcements administered to their 
pairmates. 2 groups of 15 pairs of children each were run in an experi- 


ment involving time taken to solve 2 
randomly chosen child was either positively or negatively verbally rein- 
forced. A control group of 15 pairs was also run without reinforcem 
Whether reinforcement was explicit 
it was found that positive reinforce 


forcement hindered performance. 


inforced by observing their pairmates 


2 


cant!y better than all other groups. 


thought to be limited to small groups an 


PO are many ways in which an 
gin a particularly a human, may 
respo BOrmauon about the outcomes of 
he eee which he makes or can make. 

erties obvious way is by making a 
Sites and then either enjoying or 
is ra its consequences. Such is what 
fent E by direct, explicit reinforce- 
ve ‘4 or the most part psychologists 

the tg themselves to the study of 
disio tect on an indiviual’s behavioral 
ia sitions of the reinforcements di- 
a contingent upon his own Te- 
in ‘ited However, among the other ways 
come me response consequences may þe- 
evident is by the observation of 

bel a of other persons (Camp- 
nie 961, 1963). Under some cir- 
me an individual may observe 
re er person behaving, observe rem- 
tea being delivered to the other 
ra in such a way that they seem 
and aoe upon particular responses, 
enci hereby have his own response tend- 
ies altered in a congruent manner. 


SS 


1 + 
Norn investigation has b 
tion Western University’s 
Doragpsiects sponsored by 
Kien, The writer wish 
rnan for assistance 10 


seaallace for a careful rea! 


een supported by 
psychology-educa- 
the Carnegie Cor- 
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ding of the manu- 
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puzzles. Between the 2 puzzles 1 


ent. 


or implicit made no difference, but 
ment facilitated and negative rein- 
The group that was implicitly re- 


subjected to reproof was signifi- 
Implicit reinforcement effects are 
d competitive situations, 


Much of what has been called imitation 
or observational learning (Miller & Dol- 
lard, 1941; Rosenbaum, 1961) is of that 
general nature. Berger (1961), using 
the term “vicarious reinforcement” sug- 
gested by Lewis and Duncan (1958), 
has been able to demonstrate the learn- 
ing of words and numbers on an inci- 
dental basis as a function of reinforce- 
ments delivered to a participant. More 
recently he has been able to demonstrate 
a conditioned GSR in subjects who were 
watching someone else receive what they 
thought was an electric shock (Berger, 
1962). 

On the other hand it is possible that 
under different circumstances an ob- 
server might watch the reinforcements 
being delivered to a model and have his 
own behavior tendencies altered in a 
direction opposite to the alterations pro- 
duced for the model. Thus, for example, 
Briggs (1927, 1928) reported the retro- 
spective accounts of early school experi- 
ences by high school and college stu- 
dents. He found that his respondents 
rather consistently reported having been 
adversely affected by sarcasm directed 
at them by a teacher. However, they 
also rather consistently reported that 
observing another pupil become the ob- 
ject of a teacher’s sarcasm had a salu- 
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tary affect on their own behavior. Thus 
the apparent effects produced for the 
observer and for the actual recipient of 
the reinforcement are opposites. If it is 
possible for an observer to make some 
inference about the adequacy of his own 
responses from the observations of rein- 
forcements delivered to a model, then 
the observer may have his own response 
tendencies altered and we may say that 
he has been implicitly reinforced. For 
example, if a mother comes upon two of 
her children drawing a picture and says 
to one of them, “My that’s a very nice 
picture you’re drawing,” and says noth- 
ing to the second child, it would not be 
surprising if the second child supposed 
that his own picture was by comparison 
inferior and if he then behaved as if he 
had been negatively rather than posi- 
tively reinforced. In such a case we 
might say that the observing child was 
implicitly reinforced, It has been found 
that children are quite aware of verbal 
reinforcements administered to their 
classmates (Sechrest, 1962). 

One type of situation in which im- 
plicit reinforcement of an observer js 
quite likely to occur, i.e., in which the 
effect produced on the observer js the 
opposite of that produced on the model, 
is one analogous to a zero-sum game, or 
in which the observer holds to a “de- 
pleted pool” hypothesis about available 
reinforcements. If 4 reinforcing agent 
has only so many reinforcements to dis- 
pense, then every reinforcement de- 
livered to one person reduces the possi- 
bilities of reinforcement for every other 
person. For example, if a parent has 
only one piece of candy with which to 
reward two children, the dispensing of 
the candy to one child would not neces- 
sarily be expected to produce a con- 
gruent effect in an observing child. 

In this paper an experiment js Te- 
ported in which young school children 
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were engaged in pairs in an experimental 
task during which the experimenter 
made a comment to one of the children 
which apparently made it possible for 
the other children to make some infer- 
ence about the adequacy of his own per- 
formance and thus implicitly rather than 
explicitly be reinforced. For the sake of 
argument it is assumed that implicit 
positive reinforcement occurs in the pait 
in which explicit negative reinforcement 
is given. Similarly implicit negative 
reinforcement should occur when direct 
positive reinforcement is given. 


PROCEDURE 


Preliminary work showed that it was a 
sible to affect the speed with which epia 
would work on a puzzle task by employe 
general verbal reinforcements. For this, va 
the experimental task was the completion e 
a pair of wooden jigsaw puzzles of the ee 
usually found in toy stores. The puzzles wg 
of a moderate level of difficulty, having ly- 
and 21 pieces, respectively, The data for ae 
sis were the difference scores between the or 
time scores (log transformation to correct the 
skewness) for the first and the second of 
two puzzles, ar 
In order for implicit reinforcement to ae 
the subjects must have the opportunity en 
make observing responses; therefore, childret 
were run in pairs, Each child of a pair ee 
given one of the two puzzles to work, helt 
following completion by both children of hee 
puzzles, each child was given the second One 
they exchanged, Thus, all the subjects wor rs- 
the same two puzzles, but in differing gi 
The experimental manipulation occurred in m 
interval between the two puzzles. In the ;0 
plicit Reinforceme i 


í nt group one of the 
children, randomly 


selected, was told, 


My, you did very well with your P 
hat was good work. Now we are goin: 
work another one, 


In the Explicit N, 
one child of e: 
was told, 


j š roup 
¢gative Reinforcement ne 3 
ach pair, again randomly sele 


Well, that real 
toh 
goin. 


ed 
ý m peme" 
ly wasn't so good. You see are 
ave trouble with that one. Now we 
8 to work another one. 
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And finally in a control group the experimenter 
merely said, 


All right, now we are going to work another 
one. 

Thus there were two experimental groups in 
ape one of the children received either a posi- 
conten a negative verbal reinforcement and a 
condition in which no evaluative com- 
oe ol were made. Time scores were recorded 
oth nearest 5 seconds, and surreptitiously, 
at the children were not aware that speed 

Was an issue. 
Pi. Tens of children were run in each 
hildisa a ai group, making 90 children in all. 
r a were selected in pairs by their teacher 
all m at about the same ability level, and 
came uae same-sex pairs. The children 
grade cl indergarten, first, second, and third 
nearly ene in the three schools in 
tere proportions for the three rein- 
Were tid groups, Experimental procedures 
staden ee by a young female graduate 
(8 vas oe The children were asked 
games.” ae inp experimenter “to play some 
overt ae very attempt was made to keep 
minimum Peon between the children at a 
level, by fede children at the same ability 
Zales, by gravee them w ork on different puz- 
session, ri ructuring the situation as a game 
reinforcer i It will be noted that the verbal 
nature a used were quite general in 
Which We did not refer at all to time scores 

i the re the measure of performance. 
Rtoups th pads and negative reinforcement 
Who had ee hildren could be divided into those 
received received explicit and those who had 
of éa Samat reinforcement. There were 
Rroup ach. The 30 children in the control 
were, of course, undifferentiated. 


e RESULTS 
The first analysis was a 2x 2 anal ysis 
Variance for the two types (positive 
fee and the two conditions 
the q cit and implicit) of reinforcement, 
Ths ata for which are given in Table 1- 
-`e results of the analysis are presented 
the a 2. It can be seen that whether 
Dicit orcement was explicit or im- 
ositi was of no consequence, but that 
nent. ve and negative verbal reinforce- 
ef oe Produced a significantly different 
ing ta with positive reinforcement tend- 
o have a facilitating effect on speed 
T hens formance on the second puzzle. 
e is no significant interaction be- 


TABLE 1 


MEANS AND STANDARD DEVIATIONS OF THE DIF- 
FERENCE BETWEEN Loc Tre or Two 
PUZZLES FOR Four EXPERIMENTAL 
Groups AND ONE CONTROL Group 


Group N M SD 
Explicit positive 15 —.46 1.81 
Implicit negative 15 27 1.88 
Explicit negative 15 19 1.80 
Implicit positive 15 —1.43 1.56 
Control 30 — 12 2.11 


tween type and condition of reinforce- 
ment. 

A comparison of the four experi- 
mental groups with the control group 
shows that only the implicit-positive 
group differs significantly from the con- 
trols (f=3.20, p<.01). The explicit- 
positive and implicit-positive groups also 
differ from each other (¢=2.05, p<.05), 
although this finding is of questionable 
meaning in view of the lack of a signifi- 
cant main effect for condition of rein- 
forcement. 


DISCUSSION 


We have seen that a negative 
reinforcement delivered to one child 
apparently operates as a positive rein- 
forcement for another child who is par- 


TABLE 2 


ANALYSIS OF VARIANCE OF LoG TIME SCORES 
ror FoUr EXPERIMENTAL GROUPS AND 
OxE CONTROL Group 


Source df MS F 


Type of reinforcement 


(positive or negative) 1 21.14 6.32* 
Condition of reinforcement 
(explicit or implicit) 1 2.90 <1.00 
Type x condition 1 4.07 1,22 
Within groups 56 334 
Total 59 
* p<.. 
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ticipating in the same activity. Con- 
versely, positive reinforcement intended 
explicitly for one child may have an 
implicitly negative effect on another. In 
fact in the experiment just described 
there was no overall difference attribut- 
able to the condition of administration 
of the reinforcement, i.e., whether it was 
explicit or implicit. The principal result 
in the experiment was the difference be- 
tween positive and negative reinforce- 
ments in producing an improvement or 
a decrement in the speed of solution of 
the puzzles. However, the more detailed 
consideration of the results provided by 
t tests suggests that the implicit positive 
reinforcement was particularly likely to 
cond puzzle. 
It will be remembered that none of the 
other three groups differed significantly 


ch showed a 
provement in 
to Puzzle 2. 
t the results 
of the re- 
(1927, 
Teported being 
egative verbal 
to other 
port being 
ments made 
nts which in 
d be seen as 


It should also be 
pointed out that Kounin and Gump 


(1958) and Gnagey (1960) have re- 
ported experimental findings Suggesting 
the powerful effects on children of ob- 
serving other children being subjected 
to a teacher’s discipline. 

We may ask what the 
under which subjects may 
had been vicariously reinfo 
act as if they themselves ha 
plicit reinforcement, and the Conditions 
under which they will be expected to 
behave as if they had received an im- 
plicit, that is, an opposite, reinforcement, 
First of all it seems probable that sub- 


conditions are 
act as if they 
rced, i.e., will 
d received ex- 
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jects will behave as if they had received 
an implicit reinforcement when coni- 
parisons between performance are fairly 
evident. When the evaluative dimen- 
sion of performance is not relevant, 
i.e., when there is no expectation on 
the part of the subject that his per- 
formance is to be evaluated, then 
there would seem to be no particular 
reason why he should respond to a posi- 
tive reinforcement to a model as if he 
himself had received a negative ten 
forcement. It is to be noted in Berger's 
(1962) experiment as wel: as in some of 
the experiments of Rosenbaum (1961) 
and the experiment of Lewis and Dun- 
can (1958) that the experimental pro- 
cedures did not involve an evaluation of 
the responses of either the model or the 
observer. Hence, there was no reason 
for the subject to question the adequacy 
of his own performance. ye 

Secondly, it would seem that implicit 
reinforcing effects would be more likely 
to be found in situations in which the 
observer and the model are engaged i" 
Some sort of competitive or quasi-com 
petitive task. If the observer and the 
model are working on very different 
kinds of tasks, then an explicit rein- 
forcement to the model would seem tO 
have fewer implications for the ade- 
quacy of the performance of the ob- 
Server. If one child is drawing a picture 
and the second child is jumping rope 
and an adult comes along and says, “My 
that’s very nice,” to the child drawin8 
a Picture, the child jumping the roPe 
might well not be affected in any Way? 
at least in terms of his rope jumping: 
He might, however, decide that he wou 
rather draw pictures than jump a rope 
Third, implicit reinforcing effects wou 
Probably be minimumized in groups © 
large size. If in a classroom of is 
Sauren a teacher tells 1 child that Bi 
paper is very good, the implicit invidiov® 
comparison of other children’s papers ! 
Probably minimal, 
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EXPRESSION OF CONCEPTS THROUGH WRITING 
PXAND DRAWING AND EFFECTS OF SHIFTING 
MEDIUM 


NANCY ECHOLS WILDER 
Emory 


The frequently noted difficulty in 
cepts suggested that shiftin; 


graders observed 2 plants growing 


They then described the differences 
explained the reason for the differences ( 
scores). 2 similarly treated but unobsery 


and another expression obtained. 


drew, drew then wrote, or drew twice. 
ences and easier to explain in writing 


ence discrimination scores. 
favoring the hypothesis. 


However, CE scores were 


1 anD DONALD ROSS GREEN 


University 


verbalizing apparently learned con- 


expression of a concept from writing to 
drawing or drawing to writing woul 


d interfere with expression. 88 4th 
for 2 weeks—1 in light, 1 in shade. 
(giving discrimination scores) and 
giving cause-effect, or CE, 
ed plants were shown next 
Ss either wrote twice, wrote then 
- It proved easier to draw difier- 
. Shifting medium did not influ- 
interpreted as 


—— 


If explicit verbal rules are given, sub- 
jects often show less ability to apply or 
transfer these rules than those in groups 
asked to develop the Concepts for them- 
selves (e.g., Katona, 1940; Kersh, 1958: 
Szekely, 1950), Similarly verbalizing 
inductively derived Principles and con- 
cepts is often Teported to be difficult 
(e.g., Buswell & Kersh, 1956; Corman, 
1957; Smoke, 1932). Further it has 
been suggested that when subjects re- 
quired to verbalize such derived con- 
cepts have difficulty in doing so the abil- 
ity to apply or use them is inhibited 
(Hendrix, 1948; Schwartz, 1955). 

A noteworthy fact about all 
studies is that a shift from one mea 
expressing the learning t 
involved. In each, either Pictorial, 
mathematical, or some other form of 
symbolic representation of the ideas was 
used initially and verbal expression fol- 
lowed, or vice versa. Thus, taking the 
use of a principle as a form of expressing 
the idea, both kinds of difficulty noted 
above can be explained as follows: a 
shift from the expression of an idea j 
one medium to expression in anoth 


these 
ns of 
o another was 


n 
er 


1 Now at Westminster Schools. 


medium tends to create diificulty and 
confusion. A subject who derives ap 
arithmetic principle for himself can use 
it more readily than one who is tol 
about it in words because no shift in 
form of expression is involved, but he 
will have more difficulty in describing 
the principle verbally because such 4 
shift is involved, F 

Tt may be noted that different media 
of expression often require the use 
different sets of symbols or symbol sy" 
tems which, for convenience, we will x 
codes. It seems probable that the an’ 
culty in shifting medium, hypothesize 
above, is at least partially because of the 
shift of code involved. ` 

The purpose of this study was to €% 
plore some aspects of these ideas. ae 
media of expression involving two wey 
different codes, drawing and writing 
were used by children to express an idee 
The children observed a demonstratio” 
and then were asked to express the co” 
cept demonstrated by writing oF | 
drawing a Picture. A second expressio” 
of the concept was then obtained. por 
half of the children, the second expre, 
sion was in the same code as the fir 


and for half the children the second €% 
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pression was in a different code from the 
first. 

Differences in the adequacy of expres- 
Te in the two codes were expected. 
dE is more representational of the 
we appearance of objects than is 
A iting. Writing uses languages and is 
an Ge way of communi- 
the = us, it was anticipated that on 
ap erage the two codes would prove 

proximately equal in difficulty. 
i p hypothesized that those sub- 
TA d to shift codes from the 
o peri to the second expression 
Siana n more loss or less gain on the 
rect xpression than those using the 

code both times. 
METHOD 

Subjects 


dean eae were 88 fourth grade students 
Schools A four classes in four rather diverse 
tem uses a surburban community.? The sys- 
Subjects S SOE of three-track program and all 
“advanced era drawn from those placed in 
indicated Por because a pilot study had 
Subjects th hat the task was a bit difficult for 
Was a his age. The mean IQ of the group 

Pproximately 115 on the California Test 


of 
Mental Maturity (CTMM). 


Proc edure 


wag XPerimenter told each class that this 
Wateh a neneng and they were asked to 
Petimentan T and to listen carefully. The ex- 
from er then made two very similar cuttings 
jars a coleus plant, put them in clear glass 
th po placed one in a sunny window and 

Obs er in poor light. Subjects were asked 
b erve the plants during the next 2 weeks 


n 
duri Ot to talk to anyone about the plants 
Ee that time. 
“actly 2 weeks later, the experimenter re- 


2 See 
tion 8inally three other classes in three addi- 
“Classes Schools were included. Each of these 
Vant to advertently received instruction rele- 
Scores © the task during the experiment. CE 
Dort Of these classes differed from those re- 
Clas ere. Since instruction varied from 
© class no meaningful interpretation of 


ifferences could be devised. 


a 


turned and assigned the children randomly to 
one of the four experimental treatments. 
There were four groups in each classroom, each 
yielding two expressions of the concept as 
shown in Table 1. 

Paper, mimeographed instructions, and cray- 
ons of appropriate colors were distributed. 
Then the two coleus plants were placed to- 
gether where all could see them equally well. 
Identical instructions were given to all sub- 
jects except that half were instructed to write 
and half to draw. The children were asked to 
indicate the specific differences between the 
plants and indicate why they were different. 
No time limits were set. Expression I was 
completed by dll subjects in each class after 
45 minutes. Almost all subjects had a chance 
to relax and read before beginning Expres- 
sion II. 

Then the coleus plants were removed and 
replaced by two begonia plants which had 
not been seen previously. Each subject was 
then assigned to either write or draw accord- 
ing to the prearranged schedule. Instructions 
and procedure were the same as for the pre- 
ceding expression except that the subjects were 
told that these begonia plants had been grown 
under the same conditions as the coleus plants. 
Everybody was finished in about 30 minutes 
this time. Drawing typically took longer than 
writing on both expressions. 


Scores 

Twelve adults served as judges. Each student's 
work was assigned 0, 1, or 2 points for indica- 
tions about why the plants differed. This will 
be called the cause-effect (CE) score. Both 
plant pairs differed in five major ways: root 
length, number of leaves, leaf size, leaf color, 
amount of leaf wilt. In addition, one of the 
two begonias used for Expression II was 
blooming. One point was given for each of 
the differences indicated by a subject yielding 


TABLE I 


EXPERIMENTAL DESIG) 


Group so used oo Num- 
label Expression Expression ber ol 
I Il subjects 
ww Write Write 22 
WD Write Draw 22 
DW Draw Write 22 
DD Draw Draw 22 
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a discrimination score. Thus on Expression I a 
discrimination score of 5 and a total score of 7 
was possible, while on Expression. II 6 and 8 
were possible. Expression I discrimination 
scores were multiplied by 6 and Expression II 
discriminations by 5 to adjust for this dis- 
crepancy in possible discriminations. Similarly 
total scores, i.e., CE plus discrimination scores, 
were multiplied by 8 and 7, respectively. 
Change or difference scores were obtained by 
subtracting Expression I scores from Expres- 
sion II scores. 

The judges were instructed by the experi- 
menter with illustrations from a pilot study 
to clearly establish a standard. Two judges 
scored each paper independently and then 
compared results. The overall correlation be- 
tween the two scores given each Paper was .96, 
In the few cases where the judges did not 


agree, the experimenter acted as the final 
judge. 


RESULTS 


Total difference 
significantly from 
cause CE scores 
scores did not follo 
Consequently, 


scores did not differ 
group to group be- 
and discrimination 
w the same pattern. 
total scores merely con- 


TABLE 2 


MEAN DISCRIMINATION Scores ny EXPERI- 


MENTAL Group 


Expression II 


Expression I 


code Expres- 
code s anc I 
Write Draw code 
On Expression I 
Write 19.1 16.4 17.7 
Draw 21.8 23.2 22.5 
Total x Expres- 
sion II code 20.4 19.8 
On Expression II 
Write 16.4 10.9 13.6 
Draw 14.8 14.8 14.8 
Total x Expres- 
sion II code 15.6 12.8 
Change score 
Write =27 -55 —4.1 
Draw —=70 —84 —7.7 
Total x Expres- 
sion II code —4.8 —7.0 


Nancy EcHors WILDER anp Donatp Ross GREEN 


cealed information and can be ignored. 
Since the discrimination and CE scores 
in contrast to total scores appeared to 
differ markedly from group to group on 
Expression I, it seemed desirable to 
analyze Expression I scores and Expres- 
sion II scores as well as change scores. 


Expression I Scores 


The discrimination scores for the first 
pair of plants were substantially better 
for those that drew (see Tables 2 and 3). 
As would be expected, diiferences on p 
pression I according to Expression 
code were not significant. 

The number of children with CE 
Scores of 1 or 2 is shown in Table 4- 
The proportion indicating cause was 
nificantly greater among those w 
wrote on Expression I (y?=14.9, df= i 
?<.001). For Expression I, it was easie 
to write about the cause of the differ- 
ences but easier to indicate the differ 
ences themselves in a drawing. 


TABLE 3 
` ATION 
ANALYSES of VARIANCE or DISCRIMINAT 
Scores 


dj MS F 


Expression I 


ae 
Expression I code (A) 1 501.1 12.28 
Expression II code (B) i 10.2 A 
AxB 1 920 22 
Within groups 84 40.9 


Expression IT 
Expression I code (C) 1 28.4 go 


Expression II code (D) 1 163.6 ee 
č x D 1 163.6 3 
Within groups 84 48.7 

Change scores * 
Expression I code (E) 1 2909 pA 
Expression II code (F) 1 921 1. 6 
ExF 1 102 4 
Within groups 84 64.9 a 

= 


tb <.05. 
“pio 
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TABLE 4 


Number or Susjects Exrresstnc CE BY 
EXPERIMENTAL GROUP 


. Expression IT Total x 
Expression I code Expres- 
SS sion I 
Write Draw code 
On Expressi 
Write n sae a 
ao 4 7 u 
Total X Expres- 
ston II code 20 20 
Write On “pean II R 
Draw 9 ; 7 A 
Total X Expres- 
sion II code 21 12 


on r 
Expression II Scores 


ec discrimination scores for Ex- 
Taon << did not differ significantly 

aa e experimental groups (Tables 
of subi ). On Expression II the number 
(Mamie S with CE scores of 1 or 2 
amon 4) was significantly greater 
those pee who wrote than among 

Bain me araj (x°=3.9, df=1, p<.05). 
Cause h was easier to write about the 
cess în te to show it in a drawing. Suc- 
differe e expression of the cause of the 
tende on Expression II was inde- 
sion T of the code used on Expres- 

(x?=.1, df=1). 


> RELATIVE FREQUENCY 


Change Scores 


Most subjects did less well on Expres- 
sion II in spite of the high degree of 
similarity between the two pairs of 
plants. Mean discrimination change 
scores (Expression II minus Expres- 
sion I) were all negative (see Table 2) 
as were most of the mean CE change 
scores (not shown). 

Among the discrimination change 
scores only the effects of Expression I 
were significant with the two groups 
who drew first showing greater loss than 
those that wrote first (see Table 3). If 
shifting code as such created difficulties 
one would expect a significant interac- 
tion. Thus, the hypothesis was not sup- 
ported for the discrimination scores. 


The variance analysis for CE change 
scores (not shown) indicated that only 
Expression I main effects were signifi- 
cant with the draw first groups showing 
a gain and the write first groups show- 
ing a loss. However, since CE scores 
turned out to be largely an all-or-none 
matter, the analysis of variance of these 
scores is misleading. The data shown in 
Table 5 indicate why this is so. Fifty- 
nine of the 88 subjects received the same 
CE score both times. Almost all of those 
who did indicate cause could not im- 
prove since their scores were already 2. 
Most of the remainder had O scores so 
loss was not possible. In Table 5 the 


G Number Number Jo number 
toup who could who did possible Go difference E 
Gain Lose Gain Lose Gaining Losing 

W r 

on 7 16 3 7 43 4 =i J 
Dw 9 13 1 9 11 69 —58 a 
DD 18 4 6 3 33 75 =42 f 

ie} 1 o 14 —14 2 
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percentage of subjects who did gain of 
those that could gain is compared with 
the percentage of subjects that did lose 
in score of those who could so lose. It 
can be seen that in the WW group, for 
example, 3 gained and 7 lost in score but 
the percentages are about the same. 

A chi square comparing these two 
percentages was made for each group. 
The hypothesis under test in each case 
refers to whether the percentage gaining 
differs from percentage losing. Of the 
four groups only the WD group had sig- 
nificantly more losers than gainers. Per- 
haps because of this group the combined 
WD and DD groups showed a signifi- 
cantly greater proportion losing than 
gaining (x°=9.9, dj=1, ~<.005) as did 
the combined DW and WD groups (x? 


this experiment in a single third grade 


Discussion 


On Expression I, it was easier to draw 
the differences and easier to write about 
the cause of these differen 


by a leaf, but it is not difficult to draw a 


express the 
subjects reported 
e plants were not 


Press this in their 
drawings. 


The substantial loss in score on Ex- 
pression II is in some Ways curious, One 
might have expected that the task would 
have been easier the second time since 
the plants were so similar, Possibly re- 
peating the task was not challenging. 
However losses in discrimination scores 
were just as great among those changing 
form as those repeating the same task, 
Since most subjects had a rest Period be- 


tween expressions, fatigue should not 
have affected the scores very much. 
The most reasonable explanation: for 
the large losses in discrimination as 
may be inferred from the prominence 0 
the bloom on the begonia plant. Very 
few subjects failed to note this differ- 
ence and it may have overshadowed the 
other differences, which having been 
noted once, no longer seemed important. 
This coupled with the fact that higher 
discrimination scores were obtained by 
the group that drew first may expen 
why the only treatment effect foun 
among the discrimination change scores 
was the greater loss in these groups: 
This would mean that the discrimination 
Score phenomena were largely a reflec- 
tion of the nature of the particular ma 
terials used. m 
However, CE scores did not ar 
this pattern. To be sure, the et 
ease of writing about causation probab y 
explains the more frequent me 
among the writing groups. But 
change scores do not permit any €% 
planation based on code used in sil 
sion I. From the data on CE change 
Scores one can infer either (a) that shift- 
ing code, as hypothesized, inhibits oa 
Pression, or (b) that for some asa 
reason drawing on second expression 
(but not first) interfered with CE a 
pression, or (c) that writing inhibi 
drawing but drawing does not a 
writing. Strictly speaking the data a 
not require rejection of any of ie 
three Possibilities, but since three of t” 
four subjects in the draw-write group 
who could lose did so, the third expla”? 
tion seems improbable, re 
While the significant loss in CE s©° a 
for the two groups shifting code (Group 
D and DW combined) may se 
largely because of the WD group, t 
Significantly more frequent loss — 
among the subjects who drew on as 
pression I] (Groups WD and DD che 
bined) is almost entirely because of t 
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WD group alone. Thus the second ex- 
planation also seems improbable. 
Although a check of the hypothesis is 
needed in a situation where an adequate 
range of change scores is possible, the 
Present data are more consistent with 
k notion that shifting code inhibits the 
pression of inductively derived gen- 
ralizations than they are with the two 
other possibilities. 
ana roula be noted again that the dis- 
> ico scores showed no such effect 
ibit inference that shifting code in- 
fied eee generally is not justi- 
is inet the amount of interference 
cept Th to the complexity of the con- 
little e simpler concepts would show 
Pe Nee no’ interference while the more 
titers ex concepts would show maximum 
~terence, 
m oe without denying the possible 
thar e of other explanations we feel 
shiftin e hypothesis about the effect of 
compen; code of expression is a worthy 
ing Lop of the proposition that some- 
ing ft iach to the process of verbaliz- 
bap ples interferes with the ability 
the ua, these principles. In other words 
fects “culties encountered by the sub- 
and Sen the investigations of Hendrix 
ad z wartz in particular may have 
rather ao enuen of the shift in code 
Such an the effect of verbalizing as 


F 825 z 
urthermore giving a rule in words to 


subjects who then must work with essen- 
tially nonverbal materials (e.g., Ka- 
tona) may simply complicate the task 
by adding the feature of code transla- 
tion, especially when skill in translation 
has not yet developed. 

It seems possible that this notion 
might reduce some of the apparent con- 
tradictions in the literature on instruc- 
tion and discovery in the learning and 
transfer of generalizations and concepts. 
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NOTE ON THE APPLICATION OF FACTOR ANALYSIS 


TO THE STUDY OF FACULTY MORALE? 


RICHARD C. RICHARDSON, JR., anp CLYDE E. BLOCKER 
University of Texas 


oo 


It appears evident from an examina- 
tion of the literature that the attention 
of educational administrators is being 
drawn increasingly to the area of staff 
morale. While it has not yet been con- 
vincingly demonstrated that there is any 
significant relationship between morale 
and productivity, there is general agree- 


ment that, quite apart from any effect 
morale might have o; 


ness, high morale is desirable, 


Pproach to the 
orale has been 


statements are 
d in an inven- 
are then asked 
ch item with a 
nterpreted as a 


constructed and combine 
tory. The staff members 
to select a response for ea 
favorable response being i 
high level of morale and an unfavorable 
response as a relatively lower level, 
Existing morale attitude inventories, 
patterned along this genera] line, exhibit 
a number of weaknesses. The Majority 
of them yield only a genera] Measure of 
morale. A differentia] survey which 


1 This paper is based upon a doctoral dis- 
sertation directed by the junior author and 
submitted by the senior author to the Gradu- 
ate Council of the University of Texas, 1963. 


would provide an indication of geii 
conditions contributing to low maae 
would be much more useful to the jia 
ministrator interested in taking reme¢ 
action. t to 
Those inventories which attemp ra 
be diagnostic fall into two ee 
Classes. One class, well represented ch 
the work of Redefer (1959), treats ea ts 
individual item as a factor and attemP A 
to generalize on this basis. Such ae 
proach overlooks the well-recogni s 
lack of reliability of individual j 
items. A second approach groups ng 
into categories on a more or less a pe ae 
basis, which results in a blurring of P s 
tential differences, Thus, the e 
reported by Chandler (1959) kata 
Mathis (1959) indicated that engl 
uals within the schools studied did wale 
Project differential feelings of oe 
into specific areas of their invent on 
This finding, which is in contradic s 
to most industrial studies, can be te- 
explained by an examination of the i 
gories they used and their procedu 
for assigning items. trial 
In studies conducted by industt” 
Psychologists, the number of morale o 
tors found has varied, depending E d 
the method of factor analysis used, 
whether the items were analyzed i? 


: ebt 
vidually or as parts of subtests. B2 
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and Renck (1950), using a combination 
of item and category analysis in three 
Studies, reported five primary factors. 
These were organization and manage- 
ment, immediate supervision, material 
rewards, fellow employees, and job sat- 
isfaction. 


METHOD 


an an of educational and industrial mo- 
ber or ea revealed the existence of a num- 
attitudes erential areas into which most of the 
A aa commonly associated with job satis- 

appeared to fit. On the basis of this 


review, © A 
defined: 12 categories were hypothesized and 


gommunication—The expressed attitude 
th to io toward the degree of freedom 
the admi information travels up and down 
2C Inistrative structure. 
Nema ee in Administration—The ex- 
airness, attitudes of staff members toward the 
Ness of. Ene, competence, and effective- 
Superyi. administration beyond the immediate 
3 Isory level, 
The Relations with Immediate Supervisor— 
Xpressed attitudes of staff members to- 
ae fairness, consistency, competence, 
ectiveness of immediate supervisors. 
Sprie ore with Fellow Employees—The 
Triendlin attitude of staff members toward the 
per: ess, cooperativeness, and competency 
i Sons holding positions of a similar level 
€ institution. 
iia ee with Students—The expressed 
ir Beit _Staff members toward students and 
ivities. 
attitude and Recognition—The expressed 
accorded th staff members toward the respect 
‘ceive eir position and the recognition they 
7 7 
resa eNtification with Institution—The ex- 
Pride attitude of staff members toward their 
degree te interest in the institution and the 
to which they feel they belong. 
The esofessional Growth and Advancement— 
Pressed attitudes of staff members to- 
cir opportunities for professional growth 
the a evelopment and their feelings concerning 
“dvancement possibilities of their position. 
tudes dequacy of Salary—The expressed atti- 
Of staff members toward the adequacy 


of 
wii 


Ward 
and efi 


of 
pt 
Dre, ` Adequacy of Fringe Benefits—The ex- 


emplea attitudes of staff members toward the 
Yee benefits offered by the institution. 


11. Work Environment—The expressed atti- 
tudes of staff members toward working con- 
ditions in the institution. 

12. Work Load—The expressed attitudes of 
staff members toward the work demands im- 
posed by their position. 

Several existing morale attitude inventories 
were examined and from among their com- 
bined contents 85 statements were selected on 
the basis of specific content and apparent 
relationship to the categories hypothesized. A 
group of 10 judges was asked to assign the 
statements to the hypothesized categories. 
Eleven statements were eliminated because of 
lack of agreement. The remaining 74 were 
combined in an attitude inventory and ad- 
ministered to 66 faculty members of a mid- 
western junior college. 

The responses were scored and analyzed to 
determine if the faculty members revealed dif- 
ferential attitudes toward the 12 categories 
of the inventory. Using a modification of chi 
square reported by McNemar (1955, p. 232) 
it was discovered, contrary to the findings of 
Mathis (1959) and Chandler (1959), that the 
differential categories discriminated among the 
responses well beyond the .01 level of signifi- 
cance. 

The 12 categories of the morale attitude 
inventory were subsequently subjected to a 
principal axis factor analysis utilizing the CDC 
1604 computer at the University of Texas. 
The program, written by Earl Jennings and 
Donald J. Veldman, also yielded varimax rota- 
tion of factors. 


RESULTS 


The intercorrelation matrix is pre- 
sented in Table 1. The unrotated or- 
thogonal factor loadings are given by 
Table 2. Table 3 indicates the factor 
loadings after normal varimax rotation. 

It should be noted that varimax rota- 
tion as described by Kaiser (1958) pre- 
sents an analytic solution which has 
been shown in a number of instances to 
approach the best orthogonal simple so- 
lution closely. One of the principal argu- 
ments advanced in favor of the varimax 
solution is that it removes the element of 
subjectivity from factor analysis and. 
thus, brings it more closely in line with 
the objective requirements of scientific 
inquiry. 
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TABLE 1 


TABLE OF INTERCORRELATIONS 


12 
Category 1 2 3 4 5 6 7 8 9 10 a 
E 307 
789 437 342 225 501 343 171 296 a A 
; f 503 338 359 522 341 060 237 pi EEn 
; : 433° 109.436.2356 058 128 306 726 
3 -131 435 456 197 115 305 een 
: 389 395 005 245 371 an 
6 -616 163 204 498 3 28 
; 154 118.307 nae 
s 118 239 428 S 
5 397 241 1 r 
0 f 365 417 
i c .506 
11 
12 o 
Discussion 


It was possible to identify the factors 
revealed by this study and to relate them 
to the factors identified in the industrial 


research reviewed in 


been tentatively identi- 


in Administration, 


Relations 
with Immediate 


Supervisor, and Profes- 


ORTHOGONAL FACTOR L 


Category 


- Communication 

. Confidence in Administration 

. Relations with Immediate Supervisor 

. Relations with Fellow Employees 

. Relations with Students 
Status and Recognition 
Identification with Institution 
Professional Growth and A 
Adequacy of Salary 

10. Adequacy of Fringe Benefits 

11. Work Environment 

12. Work Load 


dvancement 


PPNAnARYK = 


* Unity used as an estimate of co 


mmunality, 


sional Growth and Advancement“ mn 
factor appears to be associated with a 
attitudes of faculty members toward wi 
overall effectiveness of administrattt” 
Processes. This factor is ae 
two of the factors identified by Ba A 

and Renck (1950), Organization es 
Management and Immediate pane 
vision. The finding that a single e 
in the educational environment APP is 
to account for two factors in the inc ‘ 

trial situation may be partially explain 


iê 
e 

SL WE 

-17 —.14 83 

80 — 04 —.20 69 

56 31 — 50 mM 

57 41 — 22 70 

53 =i 13 69 

78 = 07 — 14 76 

64 —06 -.14 46 
64 16 01 ‘32 

28 49 68 63 

43 22 59 ‘60 
ral =o .26 5 

55 32 30 


“Sanr 
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TABLE 3 


FACTOR LOADINGS Arter VARIMAX ROTATION 


Category 


Communication 

Confidence in Administration 
Relations with Immediate Supervisor 
Relations with Fellow Employees 
Relations with Students 

Status and Recognition 

Identification with Institution 
Professional Growth and Advancement 
Adequacy af Salary 

Adequacy of Fringe Benefits 

» Work Environment 

2. Work Load 


PaOmansune 


Se 


o 


a examination of obvious differences 
tween the organization of the two en- 
vironments. The hierarchical structure 
of the industrial concern emphasizes the 
role of the immediate supervisor. In the 
college environment, the hierarchical 
Structure is much more limited in keep- 
'ng with the concept that professionals 
are capable of self-direction and require 
a minimum of coordination. 
te Factor II has been termed Self-In- 
gration. Relations with Fellow Work- 
fie Status and Recognition, and Tdenti- 
l cation with the Institution all have 
Nigh loadings on this factor. The image 
ae a faculty member has of himself in 
os to his colleagues and the insti- 
oth a as well as the degree of respect 
which he views his colleagues, are 
characteristic of the categories with high 
“adings on Factor II. ‘The most prob- 
ak explanation for the broad charac- 
€r of Self-Integration as contrasted with 
ee and Renck’s (1950) related fac- 
or, Fellow Employees, appears to be the 
act that, within a colleague group of 
Professionals, more support is derived 
hg Peers than from the administra- 
i Consequently, a professional’s self- 
age and the degree to which he identi- 


aes = ent ae # 
ii II I IV 
-80 -16 0D 
82 AS 83 
73 37 69 
28 78 A 
04 16 70 
37 62 69 
08 a7 -76 
46 13 46 
-10 sad 82 
23 —.08 -63 
36 as 60 
16 07 


fies with his institution are more closely 
related to his views of his colleagues and 
their views of him than would be likely 
in the industrial environment among 
nonprofessionals. 

Factor III has been called Institu- 
tional Environment. Categories with 
high loadings on this factor are Rela- 
tions with Students, Professional Growth 
and Advancement, Work Environment, 
and Work Load. Factor III is best 
thought of as relating to the conditions 
under which a faculty member works. 
Several of the categories which have 
high loadings on this factor also have 
substantial loadings on Factor I. It is 
likely that many of the conditions load- 
ing on this Factor are also related 
to Supervision, but their relationship 
is of an indirect nature. For example, 
the work load of a given faculty member 
is determined by administrative pro- 
cedures, but policy ordinarily governs 
this assignment and it is probable that a 
given level is accepted as a part of the 
conditions of employment, rather than 
being considered as within the scope of 
administrative judgment. Factor IIT 
closely parallels Baehr and Renck’s 
(1950) factor, Job Satisfaction. 
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Factor IV has been named Employ- 
ment Rewards. Two categories, Ade- 
quacy of Salary and Adequacy of Fringe 
Benefits, have high loadings on this fac- 
tor. The general nature of this factor is 
obvious from the categories which load 
on it. Factor IV is directly comparable 
to Baehr and Renck’s (1950) factor, 
Material Rewards. It is interesting to 
note that the two categories defining 
Factor IV have small loadings on the 
other three factors. The majority of 
studies in industrial research have found 
that the area of job rewards was a rela- 
tively independent dimension of em- 
ployee morale, 


CONCLUSIONS 


The findings of this study indicate 
the desirability of utilizing the recent 
advances in industrial research to iden- 


larities in the organization and purpose 
of educational institutions as opposed to 
business concerns. The technique of fac- 
tor analysis can provide the opportunity 
to improve both the methods used an 
assessing faculty morale and the clarity 
with which these assessments are re- 
ported to educational administrations. 
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CONCEPT ATTAINMENT OF HIGH SCHOOL 
SOPHOMORES’ 


LEROY A. OLSON? 


University of 


Wisconsin 


Concept attainment problems involving pictorial and symbolic stimuli 
were presented to 96 high school sophomore students. Type of instance, 
order of instance presentation, sex, and amount of practice were included 
in a complete factorial design. Analyses of variance indicated: attain- 
ment of pictorial instance concepts was significantly higher when stimuli 
were presented in an obvious to subtle order; no significant differences 


in concept attainment when positive 


instances were presented alone or 


in conjunction with negative instances; Ss with less practice did as well, 
after the first problem, as more experienced Ss; and sex differences in 


concept attainment problems appeare 
concept. 


d to depend on the nature of the 


i One type of conceptualizing activity, 
nown as concept attainment, involves 
distinguishing examples of a class of 
things which one wishes to discriminate 
pirtnes, Goodnow, & Austin, 1956). 
his process appears to play an im- 
Portant part in the classroom activity of 
the secondary school. An understanding 
Of the effects on the concept attainment 
Process of variables which may be ma- 
oe in the classroom might help 
Structors to facilitate such a process. 
mi number of variables which way be 
Wer rolled in classroom presentations 

€ investigated. The specific purpose 
Of this study was to determine the ef- 
ia of varying the type of stimuli and 
the order of presentation of stimuli on 
€ concept attainment of high school 
Sophomores, 
ieee types of stimuli were used: posi- 
€ instances and negative instances. 
aa ie instances were examples of the 
cane to be attained while negative 
ances were examples of things which 
Se 
ie data on which this paper is mast 
ented oed in the author’s ee, DS 
or th in partial fulfillment of the requiremen 
e PhD at the University of Wisconsin. 
a X author is indebted to C. W. Harris, major 
els for his advice and encouragement. 
ow at Michigan State University. 
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did not illustrate the concept. The first 
hypothesis to be tested was that subjects 
attain concepts with equal efficiency 
when only positive instances are pre- 
sented as when some positive instances 
and some negative instances are pre- 
sented, 

A second hypothesis to be tested was 
that subjects attain concepts equally 
well when the stimuli or instances are 
presented in an obvious to subtle order, 
in a random order, or in a subtle to 
obvious order. 

A third hypothesis that subjects who 
had more practice in attaining concepts 
would attain concepts with the same effi- 
ciency as subjects with a small amount 
of practice was also tested. 

Finally, the hypothesis that boys and 
girls were equally efficient in attaining 
concepts was tested. 


METHOD 
Selection of Subjects 


The subjects for the study were selected at 
random from the sophomore class of a public 
secondary school. They ranged in age from 
15 to 17 years, with an average age of 15.5 
years. The average Henmon-Nelson group 
intelligence test raw score was 45.0. A subject 
15.5 years old who received a raw score of 
45 would have an IQ of 98, based on Henmon- 
Nelson national norms. 
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Statistical Design 


The study utilized a complete factorial ar- 
rangement of experimental groups (Lindquist, 
1953). Subjects were presented with four 
problems, each of which was analyzed sepa- 
rately. The complete factorial design permitted 
the use of the normal theory analysis of vari- 
ance with fixed effects. Four subjects were 
randomly assigned to each treatment group in 
order to control extraneous variables and to 
increase the precision of the experiment, 

The first two problems were presented to 
48 subjects in a 2x2x3 factorial design em- 
ploying two levels of type of instance (only 
positive instances, and both positive and nega- 
tive instances), boys and girls, and three levels 
of order of instance presentation (obvious to 
subtle order, random order, and subtle to obvi- 
ous order), 


presentation (obvio 
order, and subtle t 


Stimuli 


Four concept attainment 
ployed: (a) objects associ: 
cating motion, (b) levers, 
letters with three letters in 


e problem 
were selected by the experimenter, Five nega- 


tive-instance stimuli were selected for each of 
the four concepts by the experimenter, 


Presentation of Stimuli 


The pictures, letters, and numbers illustrat- 
ing the stimuli for the four concepts were 
drawn in black on 11x15 inch white cards. 
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The stimuli were presented at 30-second inter- 
vals. When a stimulus had been presented, it 
remained in the subject's view until all stimuli 
had been presented for a given problem. This 
Procedure was intended to minimize the effects 
of visual discrimination and memory ability. 
Stimuli were presented to groups of subjects 
having identical experimental characteristics in 
order to maintain a classroom atmosphere. 


Evaluation of Responses 


After seeing each new stimulus, the subjects 
were asked to indicate on an answer sheet 
what they considered the common element oF 
concept to be. A subject was considered to 
have attained a concept when ‘ie indicated the 
correct common element and continued to an 
dicate the same common element after seeing 
each remaining stimulus, A subject’s score ON 
a problem was inversely related to the eee 
ber of stimuli viewed before attaining th 
concept. Thus a subject attaining “a con 
after seeing two stimuli received a score of : 
and a subject viewing all 10 stimuli befor 


s : igne 
discovering the common element was assign 
a score of 1, 


Resutts 


The data for each of the four concept 
attainment Problems were analyze 
Separately. The statistical significance 
of each of the experimental factors Was 
determined by the analysis of variance. 
For the reciprocating motion concept at 
tainment problem, the order of instanc® 
Presentation factor was statistically S187 
nificant at beyond the .001 level 
=13.28, df=2/36), No other me 
Squares were statistically significant 
Means and standard deviations for ma!” 
effect groups are shown in Table 1. | 

The order of instance presentation 
factor was also Statistically significa? 
(at the .05 level) for the lever n 
cept attainment Problem (F=3.28, © 
~2/36). In addition, the sex facto! 
was statistically significant at the F 
level for this problem (F=5.74, 2 
=1/36). No other mean squares wel 
Statistically significant. a 
€ analysis of scores on the multiple” 
ree concept attainment problem " 


of-th 


CONCEPT ATTAINMENT 


TABLE 1 


MEANS AND STANDARD Deviations ror Main Errect GROUPS BY PROBLEM 


Multiple 


Main effec Reciprocating Alphabetic 
Man elect motion Lever of three order 
CON M OSD M SD M SD M SD 
Sex ai = ~ za PU É 
M: g 
send 45 3.7 46 44 66 40 44 4A 
ate 44 41 2.2 24 75 41 39 4l 
Type of instance 
Positive only 4.9 1 31 3.6 7 4.2 49 44 
Ositive and negative 4.0 3.7 3.7 3.8 6.5 3.4 3 
Order of presentation 
pivisus to subtle 3.6 5 4.6 mi 4a 43 45 
See 32 3 3.1 78 42 46 «43 
ubtle to obvious 23 2.0 26 6.2 39 3.1 87 
Amount of practice 
Practice 79 37 42 43 
61 4.2 4 4.2 


= N 0 practice 


a a statistically significant differ- 
Hecke a the .03 level) in favor of sub- 
( Fags © had completed two problems 
Second 8; df=1/72). In addition, the 
type of order interaction between sex, 
Present: instance, and order of instance 
at th ation was statistically significant 
No oe Ana level (F=3.45, dj=2/72). 
Significant. squares were statistically 
eee analysis of scores on the alpha- 
Iles concept attainment problem 
consid ed that none of the factors under 
ific eration produced statistically sig- 
ant results. 


Discusston AND CONCLUSIONS 


T hypothesis that subjects attain 
Posies mith equal efficiency when only 
bog, Ye instances are presented as when 
D ee and negative instances are 
of Dted could not be rejected for any 
sur € four concept attainment problems. 

cs receiving only positive in- 
of 4 €S Obtained higher scores for three 
the q four problems but in no case were 
ferences between groups receiving 


different types of instances statistically 
significant. This is contrary to the re- 
sults obtained by Hovland and Weiss 
(1953), although the materials and 
methods of presentation used in this 
study differ considerably from those in 
the earlier study. The results agree, 
however, with those obtained by Smoke 
(1933). 

The hypothesis that subjects attain 
concepts equally well when instances are 
presented in an obvious to subtle order 
was rejected for the reciprocating mo- 
tion and lever concept attainment prob- 
lems. The subjects receiving instances 
in obvious to subtle order achieved sig- 
nificantly higher scores on these pic- 
torial material problems. Underwood and 
Richardson (1956) achieved similar re- 
sults with verbal materials. The above 
hypothesis could not be rejected for the 
symbolic material problems: multiples 
of three and letters in alphabetic order. 

It was not possible to determine 
whether the method of instance scaling 
or the type of material used was re- 
sponsible for the failure of an obvious to 
subtle order of stimulus presentation to 
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result in more efficient attainment of 
symbolic concepts as it did for pictorial 
ts. , 
The hypothesis that subjects with 
more practice in solving concept attain- 
ment problems would attain concepts 
with the same efficiency as subjects with 
a small amount of practice was rejected 
for the mutliple-of-three problem but 
could not be rejected for the alphabetic 
order problem. This result indicated 
that unpracticed subjects attained con- 
cepts less well on their rst problem 
in comparison with more experienced 
subjects, but that they attained concepts 
as well on their second problem as more 
experienced subjects. Thus, although a 
practice effect existed, it was of rela- 
tively short duration, 


The hypothesis that boys and girls 


attain concepts equally well could not be 


rejected for the reciprocating motion, 
multiple-of-three and alphabetic order 
problems. This hypothesis was rejected, 
however, for the lever concept attain- 
ment problem, on which boys scored sig- 
nificantly higher than girls. Whether 
boys or girls are more efficient at solving 


a concept attainment problem appeared 
to depend on the nature of the particu 
lar concept. e 

All akiai received the problems 1n 
the same order, permitting the use of 4 
Prepared test answer booklet and a 
group test procedure, as well as a 
the confounding of main effects in t i: 
analysis. It was found that concepts ea 
be effectively attained when the on 
stances are presented to subjects in 
group situation, 
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FURTHER VALIDATION OF THE ENVIRONMENTAL 


ASSESSMENT TECHNIQUE’ 


ALEXANDER W. ASTIN 


National Merit Scholarship Corporation, Evanston, Illinois 


Environmental As ment Technique (EAT) measures were computed 
for 76 colleges and universities from published data about size, intelli- 
gence level, and major fields of study of students at each institution, 
and validation data were obtained from seniors. 18 items of a question- 
naire completed by the latter described their college environments and 


21 items described the perceived “effects” of 4 college years. 
responses to 14 of the 18 college environment items 
related to EAT variables in the predicted direction; 
effects of college were significantly related to 
Student intelligence accounted for a larger proportion of va 


Mean 
were significantly 
15 of 21 perceived 
at least one EAT variable. 
riance in 


the validation items than any other EAT variable. 


Siege Environmental Assessment Tech- 
the e NEAT) is a method for assessing 
attrib. ege environment based on eight 
a oe of the student body: the Size 
eal. Student Body, the Intelligence 
Sfint of the students, and the “personal 
Tiber (oe of the students as indi- 
each “a the percentage of students in 
istic 3 six classes of major fields (Real- 
tnte ntellectual, Social, Conventional, 
fost Er A ATHENE, With the 
oa e exception of the Intelligence 
com of the Student Body, data for 
aH oe EAT measures for any insti- 
publisks usually be obtained from 
hece hed sources, thus eliminating the 
é Ssity of relying on informants at 
Institution. 

nae an earlier report on a sample of 36 
Vari a (Astin & Holland, 1961), EAT 
Corre es were found to have substantial 
the oe with many of the scales of 
Pace ollege Characteristics Index (CCI; 
cent & Stern, 1958). Also, the per- 
the age of students majoring in each of 
SIX groups of fields was found to be 


1 

ot Bae Study is part of the research program 
an, National Merit Scholarship Corporation 
tonal = Supported by a grant from the Na- 
cience Foundation. 
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highly reliable over intervals of 1-6 


years. 

The primary purpose of the present 
study was to test and extend the con- 
struct validity of the EAT using a larger 
sample of institutions. The correlations 
found earlier between EAT measures 
and CCI scales—although relatively 
high—did not seem satisfactorily to es- 
tablish the construct validity of the 
EAT, since many CCI items inquire di- 
rectly into the student’s major fields of 
study and related interests. For exam- 
ple, the CCI Pragmatism scale, which 
correlated .73 with the EAT Realistic 
Orientation (Astin & Holland, 1961), 
includes the following items: “Most 
students are interested in careers in 
business, engineering, management, and 
other practical affairs” (True); and 
“Students are more interested in spe- 
cialization than in general liberal educa- 
tion” (True). Since the percentage of 
students majoring in engineering deter- 
mines to a great extent the Realistic 
Orientation of the college, it is hardly 
surprising that these two scales are sig- 
nificantly related. A similar example 
occurs with the CCI scale, Sentience, 
which includes the following items: 
“There is a lot of interest here in poetry, 
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music, painting, sculpture, architecture, 
etc.” (True); and “The college has a 
vested very little in drama and dance 
(False). Sentience, in turn, correlated 
.69 with EAT Artistic Orientation, 
which is defined as the percentage of 
students majoring in art, music, English, 
journalism, etc.? mp 

Since CCI is, in a sense, an indirect 
method for determining the distribution 
of major fields at an institution, then 
correlations between CCI scales and 
EAT personal orientations may be medi- 
ated by the curriculum at the institu- 
tion, rather than by aspects of its “psy- 
chological climate.” In short, high 
correlations between two methods for 
counting the major fields at an institu- 
tion do not necessarily indicate that 
either method is a valid measure of the 
psychological environment at the coliege, 

To avoid these difficulties, the present 
study attempted to explore the construct 
validity of EAT directly by using items 
specifically designed to test the proposed 
interpretations of each EAT variable, 

A secondary Purpose of the present 
study was to try out an alternative 
method for scoring the six EAT personal 
orientations. In the earlier report (Astin 
& Holland, 1961), each major field was 


six personal 
ever, since certain ma- 
jor fields probably combine attributes of 
more than one personal orientation, it 
seemed likely that more valid estimates 
of each personal orientation could be 


2? Similar possible circularities occur with 
other EAT-CCI correlations, even line ie 
volving the Intelligence Level of the Student 
Body. For example, the Achievement scale of 
the CCI, which correlated .64 wit 


meat h Intelligence, 
includes the following items: “It is fairly easy 
to pass most courses without working very 


hard” (False); “the competition for grades js 
intense” (True). Thus, the Achievement Stale 
may be an indirect method for determining 
the level of intelligence of the student body. 


secured by applying appropriate differ- 
ential weights to these major fields. Ac- 
cordingly, in the present study the D 
(unit weight) method was compare 
with a method of differential weighting 
to see which yielded the more accurate 
scores for the six EAT personal orienta- 
tions. 


METHOD 
Sample of Institutions 


Information about the coñcge environmen s 
was obtained from students at some 76 a 15 
ent colleges and universities which corel? o 
or more students from a larger Sa com 
Finalists and recepients of the Letter of holar- 
mendation in the 1957 National Merit Sc bere 
ship program. The students, who num! ailed 
from 15 to 216 per college, completed a m3 
questionnaire at approximately the en 
their senior year in college. à 

The EAT measures for each institutio arlier 
computed in the manner outlined in the ition, 
report (Astin & Holland, 1961). In ad com- 
the six EAT personal orientations were ential 
puted according to a system oft ien o 
weights which assigned certain major bes field 
two personal orientations. A given maor sna 
could thus be divided between bye ae of 
orientations using one of the following Fi nd 
weights: .25 and .75, 50 and .50, and - idere 
-25. (Major fields which were still Coe gaia 
pure types—i.e., belonging in a single DO for 
orientation—were given a weight of w t 
that orientation.) Decisions about Bor ily 
Weight each major ficld were made pt retic® 
pn the basis of Holland's (1962) theo pi- 
formulations for cach of the six persar aani x 
entations. Some of the more important T ents 
from the pure system are as follows: § y 
majoring in architecture (formerly score were 
under the Intellectual Orientation) for 
weighted .50 for the Intellectual and ing in 
the Artistic Orientations; students ma y” 
business or economics (formerly scored, e Com 
Conventional) were weighted .50 for nid 
ventional and .50 for the Enterprising or BL 
tions; students majoring in sociology ° ere 
chology (formerly scored only as Soca for 
Weighted .25 for the Intellectual and - 


ae 


n were 


mole 
"This sample has been described i 
detail elsewhere (Astin, 1963). 
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the Social Orientations.‘ Since the total 
weight contributed by any one student al- 
Ways summed to 1.00, the system of differen- 
tial weights still resulted in six scores which 

summed to 100 (%) for each institution. 
ae was anticipated that the criterion used to 
lect institutions for this study (i.e. that the 
ee enroll at least 15 of these highly able 
ca would produce a sample in which the 
2 cation between Size and Intelligence Level 
high e Student Body would be spuriously 
he z nce any small institution, in order to 
ked c raed; would have to enroll a student 
lee of very high ability level. This expecta- 
lives as borne out: in the sample of 76 col- 
See Pilg: was a correlation of —.57 between 
rane Intelligence, as compared with a cor- 
on of only —.09 found earlier for a 


ess select pas ok 
Holland, or of 335 institutions (Astin & 


° 


Questionnaire Items 


D kinds of items were included in the 
of a The first group, which consisted 
conse developed to examine the 
Withee, validity of each EAT variable. In 
estate these items, we tried to avoid merely 
thas the operations involved in scoring 
ea ae For example, it would probably 
“on clatively easy matter to “validate” the 
<Ohventional Orientation using items such as 
in bas of the students are planning careers 
$ sa (True or False?), simply because 
ased Ti for the Conventional Orientation is 
rho argely on the percentage of students 
would b, majoring in business. Similarly, it 
of th e easy to demonstrate the high validity 
Bod eo variable, Size of the Student 
Tee y using an item such as “This is a very 
campus.” 

md avoid such circularity, an attempt was 
conne to design items which had only remote 
Voly, eas with the actual operations 1m- 
Were in scoring the EAT variable, but which 
Posed ik the same time relevant to the pro- 
interpretations of the variable. For in- 


Saas 


E A complete table of the differential weights 
Been oing the EAT personal orientations has 
tatio deposited with the American Documen- 
rom, Institute. Order Document No. 7622 
tog ADI Auxiliary Publications Project, Pho- 

Uplication Service, Library of Congress, 
fi ashington 25, D. C. Remit in advance $1.25 
make ctofilm or $1.25 for photocopies and 
Hon | checks payable to: Chief, Photoduplica- 

Service, Library of Congress. 


stance, to test the notion that the Conven- 
tional Orientation fosters conformity (Astin & 
Holland, 1961, p. 310), the following item was 
used: “There is a set way to dress which most 
students go along with.” 

The subject answered each item in this first 
group according to a 4-point scale: true (4), 
somewhat true (3), somewhat false (2), and 
false (1). The 18 items, together with sum- 
maries of the environmental constructs pro- 
posed for each EAT variable, are given below 
with their respective predicted relationships to 
tendency to respond “true” (negative or posi- 
tive). 

Size of the Student Body. Large institu- 
tions will be ‘characterized by an impersonal 
atmosphere, with personal contacts between 
faculty and students at a minimum. The large 
number of students will probably result in a 
variety of highly organized student subcultures 
and a fairly well-defined status hierarchy of 
social groups. 

Item 1. There is a lot of personal contact 
between students and faculty members (nega- 
tive). 

Item 2. Many of the social groups on cam- 
pus have a definite “snob” appeal (positive). 

Ability Level of the Student Body. Colleges 
with student bodies of relatively high intelli- 
gence will also be characterized by a relatively 
high emphasis on academic pursuits and on 
scholarship. Since ability level tends to be 
related to other assets of the institution, in- 
cluding the level of training of the faculty 
(Astin, 1962), we might also expect the qual- 
ity of instruction at the institution to be 
related to the ability level of the student body. 

Item 3. The typical student spends a lot of 
time in the library (positive). 

Item 4. Many of the students are more in- 
terested in getting a degree than they are in 
what they will learn in college (negative). 

Item 5. The quality of teaching and instruc- 
tion is markedly superior to that in the aver- 
age institution (positive). 

Realistic Orientation’ The realistic environ- 
ment will be characterized by a relatively high 
incidence of aggressive, masculine activities. 
“Acting out” (as opposed to “thinking 
through”) will be the preferred method for 
coping with problems. 

Item 6. Practical joking among the students 
is fairly common (positive). 


5 Theoretical formulations for the six EAT 
personal orientations were abstracted from the 
carlier paper (Astin & Holland, 1961) and 
from Holland’s (1962) theory of vocational 
choice. 
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Item 7. An outburst or demonstration among 
the students would not be very likely (nega- 
tive). 

Intellectual Orientation. The intellectual en- 
vironment will be characterized by a tendency 
to underemphasize interpersonal relations. One 
would expect the introverted student to feel 
more at home in this environment. 

Item 8. A student who is introverted or 
stays pretty much to himself would feel out of 
place on this campus (negative). 

Item 9. Many of the students are interested 
primarily in getting married and raising fami- 
lies (negative). 

Social Orientation. The social environment 
will foster a relatively large amount of struc- 
tural social activity. In particular, one would 
expect the acquisition of social skills to be 
encouraged, 

Item 10. There is a good deal of emphasis 
on parties and dating (positive), 

Item 11. A student who is not very skilled 
in etiquette or social 

feel out of place on 


the part of the faculty 
Item 12. There is a 
Most students go along 


Pressure on the stude 
rules and regulations 
Item 14, Faculty members usually don’t 


like the student to question their judgment or 
point of view (positive), 


Enterprising Orientation. 
environment will fost 


persuasive skills. 
Item 15. Students ar 
or debate almost any i 
Item 16. There is 


e always ready to argue 


campus (positive). 

Artistic Orientation. The artistic environ- 
ment will be characterized by a highly indi- 
vidualized (or opposed to a group) approach 
to problem solving, One Would expect the 
development of gross physical skills to be dis- 
couraged. 

Item 17. Students are more inclined to 
pursue their own individual projects than to 
engage in group activities (positive), 

Item 18. The students show a great deal of 
interest in competitive sports (negative), 

The second group of items included in the 
questionnaire was intended to examine the 
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construct validity of EAT on a more explora- 
tory basis, rather than to test specific inter- 
pretations of the variables. Two of these 21 
items were designed to elicit the studeut’s 
general evaluation of his college: “What would 
you describe as the main assets or strong 
points of your particular college?” (open- 
ended response); and “What would you de- 
scribe as the main liabilities or faults of your 
particular college?” (open-ended response). 
The remaining 19 items were designed a 
assess the student’s evaluation of how his z 
years in college had affected his values, hia 
ests, and personal development. The auger 
was instructed to judge the extent to whic 
the college had influenced him in the ae 
ing areas: Clarity of vocatioial plans, soa 
habits, poise in groups, gencral personal deve š 
opment (4-point scales: marked improve” 
ment, some improvement, no change, Les 
than when I entered college); interest in ENI 
and music, knowledge of etiquette, and Dr 
graces, ambition, interest in sports, conte 
over grooming and personal apps sa 
amount of drinking, interest in world Saeed 
concern for feelings of others, interest 1n se 
ence, self-confidence, tendency to argue sae 
debate issues (4-point scales: marked increas 
some increase, no change, less than pier 
entered college); attitudes toward formal A 
ligion, fraternities and sororities, iarna 
(5-point scales: much more positive, somew! A 
more positive, no change, somewhat more A 
tive, much more negative) ; political at s 
(S-point scales: much more conservati ie 
somewhat more conservative, no change, som 
what more liberal, much more liberal). 


Analyses of Data 


Mean scores on each of the 39 items ba 
computed separately for each of the 76 sage 
tions. Product-moment correlations were 
computed between these means and the 
EAT variables (Size, Intelligence, and pie 
personal orientations scored in two ways). sj- 

Intercorrelations among the eight EAT “hal 
ables scored by the method of differe oa 
weights were also computed using the arien i 
sample of 335 institutions (Astin & Holla 
1961). 


six 


RESULTS 


A comparison of the analyses pA 
cated that of the two methods for e 
ing the six Personal orientations, 
method of differential weights is 8° 
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TABLE 1 


INTERCORRELATIONS OF EAT Vartastes Ustnc Two Metnons® oF SCORING THE SIX 


PERS! 


NAL ORIENTATIONS 


(N = 335 institutions) 


Variable 1 2 
l. Size ` —.09 
2. Intelligence —.09 
3. Realistic Orientation .25 —.06 
: pelea Orientation —.16 AT 
+ Social Orientation =17 —.29 
7 Conventional Orientation 33 —.33 
¥ pet ae Orientation —.09 32 
» Artistic Orientation — .26 -13 


3 4 5 6 7 8 
26 —28 —06 26 —25 —.29 
-08 41 —36 —2 A334 
sah =.37 - —46 —.57 
24 —40 —. 3816 
—.53 —.57 - —32  —01 
—10 —.25 —.30 —12  —.30 
—48 06 —.29 29 45 
—60 —.30 51 —42 —.03 


Note.—rios = 11, ror = 14. 


“Inte : ; : i 
the 12icrcorrelations using the differential 


Weigh 


erally superior to the method of unit 
cc used in the earlier study (Astin 
& Holland, 1961). Six of the 13 items 
gen to test specific interpretations of 
nif personal orientations yielded sig- 
the. results in the predicted direction 
jiena the unit weights were used, 
ile 9 of the 13 items yielded sig- 
= cant results when differential weights 
ere used (see below). 

Table 1 shows the intercorrelations— 
i on both scoring methods—of all 
Pie EAT variables, for the original 
Maple of 335 institutions (Astin & Hol- 
eae 1961). Using differential weights 
R reases the amount of experimental 
Pa endence among the six personal 
me ations, but only slightly: the mean 
be €rcorrelation (ignoring sign) in- 
Teases from .29 to .33. The intercorre- 
ations which were most affected by the 
‘ferential weighting system included: 
> yalistic x Intellectual (from —.24 to 
24), Intellectual x Enterprising (from 
8 to .06), Intellectual x Artistic (from 
16 to ~.30), Social Artistic (from 
me to .51), Conventional x Enterpris- 
fae (from —.12 to .29), and Enterpris- 
the Artistic (from .45 to —.03). With 
iet Possible exception of the correlation 

tween the Intellectual and the Artistic 


perlet triangular matrix; the upper-right triangul: 
g (pure) scoring system used in the previous report (Astin & Holland, 1961, Table 5). 


weighting system for scoring the six personal orientations are given in 
ar matrix shows the intercorrelations based on the unit- 


Orientations, the correlations produced 
by the differential weighting system con- 
form more closely to the theoretical 
descriptions of the personal orientations 
(Holland, 1962). Correlations of the six 
personal orientations with Size and In- 
telligence were not changed appreciably 
by the differential weighting system, al- 
though the mean correlation (ignoring 
sign) was reduced slightly from .28 to 
24, 

Distributions of scores for the 335 in- 
stitutions on each personal orientation 
also tend to be more symmetrical when 
the scores are based on differential 
weights than when they are based on 
unit weights. 

Since using differential weights for 
the personal orientations resulted in 
scores which have greater validity and 
more desirable statistical properties than 
the scores based on unit weights, the 
remaining results are presented only for 
this revised scoring procedure. 

Table 2 shows the correlations be- 
tween the eight EAT variables and the 
mean scores for the 39 items. 

Fourteen of the 18 predicted relation- 
ships (coefficients in boldface type in 
Table 2) were confirmed (p<.01). Of 
the 144 correlations computed between 
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CORRELATIONS * or EAT VARIABLES WITH 18 RATINGS 
AND WITH 21 PERCEIV] 
(N = 76 Colleges, 


TABLE 2 
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OF THE COLLEGE ENVIRONMENT 
ED EFFECTS OF THE COLLEGE 
15-216 student raters per college) 


Item 


Size 


of stu- 


dent 
body 


Ratings of the environment 
1. Amount of faculty- 
student contact 
2. “Snob” appeal of 
social groups 
3. Time spent by stu- 
dents in library 
4. Students’ orientation 
to getting a degree 
rather than learning 
5. Superior quality of 
teaching 
6. Practical joking among 
students 
7. Likelihood of student 
demonstration 
8. Rejection of intro- 
verted students 
9. Student’s interest in 
marriage and family 
10. Emphasis on Parties 
and dating 
11. Rejection of student 
who lacks social skills 
12. Student's conformity 
in dress 
13. Administrative pres- 
sure on students to 
conform to rules 
14. Faculty resentment of 
students’ criticism 
15. Student’s eagerness to 
argue and debate issues 
16. Competition for leader- 
ship positions 
17. Individualism of stu- 
dents 
18. Students’ interest in 
competitive sports 


40 


39 


—33 


36 


Intelli- 
gence 
level of 
student 
body 


—39 
—69 


—50 


~45 


—56 
—70 
59 
—61 
61 


=57 


EAT variable 


Personal orientation 


Intel- Con- À 
Real- lec- ven- Enter- Artis- 
istic tual Social tional prising tic 
—53 35 —40 41 47 
—33 44 i 
=53 37 -so so 59 
oy 56 --30 —44 
—35 59 42 4 
30 30 37 = 
~30 35 
—58 36 38 
—32 -— 44 
=3) 37 3232 
—34 30 
—36 34 
37 —31 86 —32 —40 
~34 säi 41 
—33 41 =< 
34 42 = 
—36 
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TABLE 2—Continued 
* CorreLations® or EAT VARIABLES WITH 18 RATINGS or THE COLLEGE ENVIRONMENT 
AND WITH 21 PERCEIVED EFFECTS OF THE COLLEGE 
(NV = 76 Colleges, 15-216 student raters per college) 
EAT variable 
- 7 7 Personal orientation 
Item Size Intelli- 
of stu- gence 
dent levelof Intel- Con- , 
body student Real- lec- ven- Enter- Artis- 
. body istic tual Social tional prising tic 
Perceived effects. i 
Improved 
19. Clarity of vocational 
plans 
oe Study habits —41 cae 
a Poise in groups 34 —44 
2. General personal 
development 
Increased 
23. Interest in art z 
x and music -4l 47 —59 51 —33 40 59 
“4, Knowledge of etiquette, m 
sa social graces 41 —59 —42 36 
> Ambition —54 -34 
6. Interest in sports —33 40 —42 “Be = 
20, Concern over groom- 2 
28 ing and appearance 57 —70 =a da Sal 
39, Amount of drinking 
» Interest in world 
4 affairs 30 
30. Concern for feelings 
5 of others re z 
a Interest in science 34 =s 53 =e SRE 
as Self-confidence —46 
~ Tendency to argue 
and debate issues 
More Positive attitude toward 32 
35, ormal religion —32 
> Fraternities and g 49 
3g, Sororities = a =38 = = 
» Conservati itica 
n aise ative political i = 44 37 45s 34 —49 
- Marri —44 
38, age _3 59 
39, Number of Assets —40 52 =H i a i 


Not 


Q 


umber of Liabilities 


Co; 


(—). 


nly significant (p < .01) correlations are shown. 


Note. Predicted relationships which were confirmed are shown in boldface; predicted relations| 
nfirmed are shown by a dash 


hips which were 


Decimal points have been omitted. 
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EAT variables and the 18 ratings of the 
college environment shown in Table 2, 
81 (56%) were significant (p<.01). 
Thirty-four percent (57 out of 168) of 
the correlations computed between EAT 
variables and the 21 perceived “effects” 
of college shown in Table 2 were signifi- 
cant. 

To facilitate interpretation, the spe- 
cific results for each of the EAT vari- 
ables are discussed separately, 

Size of the Student Body. Both of 
the predicted relationships (Items 1 
and 2) were confirmed. As expected, 
the pattern of correlations involving Size 


tends to be the opposite of the pattern 
involving Intelligence. 


Intelligence Level 
Body. All three predicted relationships 
involving Intelligence (Items 3, 4, and 


5) were confirmed, Twenty-eight of the 
39 items had s 


e orrelations involving 
Intelligence suggests that the e 
ments at institutio 


and 9), 
and 17); by little em 
activities (Items 1, 10, and 16) and 
sports (Item 18); and by a relatively 
low degree of administrative control 
(Items 13 and 14). Intelligence is also 
related to a perceived increase of in- 
terest in art and music and a perceived 
decrease of interest in science (Items 23 
and 31). Other findings which may 
have significance are the negative relą- 


tionships between Intelligence Level o! 
the Student Body and the perceived 
effect of the college experience on “sẹlf- 
confidence” and “ambition.” These lat- 
ter relationships suggest the interesting 
hypothesis that continued exposure to a 
peer groun of unusually high intelli- 
gence has a detrimental effect on the 
self-confidence and ambition of some 
students, ith 
Realistic Orientation. Results wi 
the two “acting-out” items lend anly 
equivocal support to this hypothesized 
aspect of the Realistic environment. 
Only one of the items (“practical pi: 
ing”) was significantly related in bes 
predicted direction, and the einem 
was low (r=.30). Students at cae 
with high Realistic Orientations tend 7 
report fewer assets of the college on es 
open-ended question (r=—.68), oe 
they do not at the same time oo 
more liabilities, They say that colles' 
has decreased their interest in art +“ 
music and increased their interest ? 
science. The Realistic Orientation ee 
a higher correlation (r=.57) with P 
tive attitudes toward fraternities ie 
sororities” than any other EAT yarab 
Intellectual Orientation. Results Ti 
both items for the Intellectual onar 
tion confirmed the predictions (e e 
8 and 9). All items pertaining tO ter- 
importance of social groups and in 24, 
personal skills (2, 10, 11, 12, 16, 17, ted 
and 27) tended to be negatively rela 
to the Intellectual Orientation. the 
Social Orientation. Only one of re- 
two items (11) produced significant e 
sults in the predicted direction for ie 
Social Orientation, although the eee - 
tion of that item with the Social om 
tation (r=.41) was higher than W. 
any other EAT variable. The Socie 
Orientation was also the only EAT ate 
able which was significantly wee 
(r=.30) to the Perceived effect © tem 
T on “interest in world affairs” (I 
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_ Conventional Orientation. All three 
items constructed for the Conventional 
Orientation (Items 12, 13, and 14) pro- 
duced significant results in the predicted 
direction. Other relatively high cor- 
relates of this Orientation included the 
time spent by students in the library” 
("=—.50), the estimated “snob” ap- 
Peal of the social groups (7=.44), the 
S ae quality of teaching (r=—.59), 
student interest in competitive sports 
Le a perceived increase in con- 
2 n Over grooming and personal appear- 
ce (r=.42}, and more conservative 
Political beliefs (r=.45). 
acters Orientation. Only one of 
e two items designed for the Enter- 
rine 3 Orientation (Item 15) produced 
“pe icant results: “Students are eager 
The oe and debate issues” (r=.41). 
thei nterprising Orientation also had 
cage correlation of all the EAT 
te les (r=—.55) with increased in- 
rest in science (Item 31). 
oe Orientation. Only one of the 
“ent designed for the Artistic Ori- 
ones Ne? (Item 18) yielded a significant 
oe in the predicted direction 
the Pres The highest correlates of 
on mastic. Orientation included the 
ara time spent by students in the 
ai reed (r=.59), the perceived effect 
fast A college on “interest in art and 
es (r=.59), and the number of as- 
ina of the college reported on the open- 
ed question (7=.59). 


Discussion 


ee general, the results seem to sup- 
ae construct validity of EAT as a 
me od for assessing the college environ- 
“a Fourteen of the 18 predicted re- 
lonships were confirmed, even though 
fe items were selected to test relatively 
ey hypotheses about each EAT 
st Furthermore, there were many 
Barna correlations between the 
variables and the effects of the 


college as perceived by the student. 
However, only partial support was ob- 
tained for some of the proposed inter- 
pretations of the Realistic, Social, En- 
terprising, and Artistic Orientations. 

Some of the findings in the present 
study seem to be relevant to a recent 
study of differential college effects 
(Astin, 1963), in which it was found 
that the aspiration of the talented stu- 
dent to obtain the PhD is negatively af- 
fected both by the Size of the Student 
Body and by the Conventional Orienta- 
tion. In the present study, Size and the 
Conventional Orientation had similar 
patterns of relationships to the valida- 
tion items. For example, institutions 
with high scores on these two EAT vari- 
ables tend to emphasize sports and social 
activities (Table 2, Items 2, 10, 16, 24, 
and 27) at the expense of academic 
pursuits and scholarship (Items 3, 4, 
and 9). According to the student in- 
formants, faculty members at these in- 
stitutions have fewer contacts with the 
students (Item 1), are poorer teachers 
(Item 5), and are resentful of criticism 
(Item 14). In addition, Size and the 
Conventional Orientation were the only 
EAT variables significantly related to 
the perceived effect of college on “im- 
provement in study habits” (Item 20; 
for both variables the correlation was 
negative). Thus, it seems plausible that 
a college environment characterized by 
this complex of attributes tends to dis- 
courage the pursuit of higher academic 
degrees. 

The large proportion of variance in 
the 39 validation items which was at- 
tributable to Intelligence Level of the 
Student Body poses a problem. This 
finding can be explained partially by 
the spuriously high correlation between 
Intelligence and the other EAT vari- 
ables in the present sample of 76 institu- 
tions; in the larger sample of 335 insti- 
tutions (Table 1), Intelligence accounts 
for only a small proportion of variance 
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in the other EAT measures. It is clear 
that more precise differentiation among 
the eight EAT variables will require ad- 
ditional studies of less biased samples of 
institutions. 
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RELATIONSHIP OF REACTIVE INHIBITION TO 


READING SKILL 


WAYNE OTTO 
University of Oregon 


AND 


ATTAINMENT 
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Portland Continuation Center 


The purpose of this study was to examine the relationship of reactive 
inhibition to skill attainment in reading, and the details of measuring 


reactive inhibition by an inverted nu 
numbers of good and poor readers in 


the study. A repeated measures analy 


mber printing task. 100 Ss—equal 
Grades 4, 5, 6, 7, and 8—served in 
ysis of variance was employed. It 


was found that as expected, poor readers generate reactive inhibition 


more rapidly than good readers, and 


appears to be satisiactory for quantifying reactive inl 


ee study by Lynn (1960) ex- 
pon a pe effect of reactive inhibition 
The jie, attainment of skill in reading. 
es bat a reveal a low but significant 
tween pi <.05) negative correlation be- 
hibitio he accumulation of reactive in- 
numb n, as measured by an inverted 
Siding printing task, and ability in 
te et The finding gives some support 
Bar hypothesis, based upon Hullian 
inhibi that the more rapidly reactive 
quatel lon accumulates the less ade- 

L y certain skills are acquired. 
ie dae study is rather unique in that 
ages S jects were children between the 
inte, 11 and inverted number 
tive al was employed to measure reac- 
Bior eitim The traditional ap- 
alphab has been to employ inverted 
with r printing or rotary pursuit tasks 
ka ult subjects in studies involving 
dere. inhibition. An inverted number 
adva ng task appears to have a distinct 
q an (see below) for use with chil- 
i de However, Lynn has not reported 
iun upon the implementation of the 

Aer printing task. 
(a) eee study has two concerns. 
ibiti he relationship of reactive 1m- 
skil] on and the attainment of reading 
esis jis examined further. The hypoth- 
Reacts, that good readers generate less 
„ tive inhibition than poor readers in 
Riven period of time. A demonstration 
a clear relationship between reactive 
227 


d number printing task 
hibition in children. 


the inverte 


inhibition and skill attainment in read- 
ing would clear the way for studies de- 
signed to get at implications for instruc- 
tional procedures. (0) The details of 
measuring reactive inhibition by in- 
verted number printing are examined 
and reported. This appears to be a 
necessary prelude to further use of what 
appears to be a useful method of quan- 
tifying reactive inhibition in children. 


METHOD 
Measurement of Reactive Inhibition 


Reactive inhibition was measured by an in- 
verted number printing task. The procedure 
generally followed that employed by Archer 
and Bourne (1956), although they used in- 
verted alphabet printing. Briefly, the subjects 
were told about the nature of the task and 
that the digit 6 is 9 upside down and vice 
versa. The latter was done to reduce varia- 
bility. The subjects were told to print the 
numbers from 1 to 10 as quickly as possible 
from left to right starting in the upper left- 
hand corner, placing one number in each 
S-inch square on the printing sheet. They 
were to print right over errors and not to 
attempt to erase. 

The experimenter put the inverted numbers 
on a chalk board after the subjects had at- 
tempted to make the inversions on their own. 
This was found to be desirable in order to get 
uniform inverted number forms from the sub- 
jects. Once this was done, the children had 
little difficulty; and they seldom consulted the 
chalk board, despite the fact that the experi- 
menter’s numbers were left there. The in- 
verted numbers appear to have a distinct 


228 


advantage over inverted letters when subjects 
are children. In pilot tryouts, it was found 
that poor readers in particular had extreme 
difficulty in making inverted letters, even after 
coaching had been done. 

Subjects were told to skip a square and 
continue with the next number when told to 
“skip.” This signal was given every 30 sec- 
onds, i.e., at the end of each trial. After 12 
massed trials they were told to stop, and a 
5-minute rest followed. The rest period was 
spent with the experimenters chatting with the 
subjects. Ten seconds before the end of the 
rest period, the subjects were asked to “get 
ready,” make 5 Xs after the last number on 
their papers, and resume printing when told to 
“begin.” Four 30-second massed trials fol- 
lowed the rest interval. 


Typically, when last prerest and first post- 
rest trials are 


rest interval, the 
reminiscence. It is assumed that the amount 


Subjects and Design 


Both the reading level a 
of subjects are considered i 


Therefore, a repeated 
(Edwards, 1950) was employed: 
reading ability, five grade levels, 
and postrest learning trials, 2 
A total of 100 children from 
schools in a suburban school 
the experiment, j 
average range (90-115), a i 
scores corroborated by th ‘cee iio test 
ers’ judgments. Good rea 
who, according to test 
evaluations, had reading 
seventieth percentile on 
Poor readers were childre: 
for the remedial reading 
fied, a child must have ai 
gence (individual IQ test 
and reading achievement 
grade level in the fourth grade a; 
years below in Grade 5 and above, 


Ten good readers and 10 Poor readers at 


al design 
two levels of 
and prerest 


Wayne Otto anp Ropert C. Frepricks 


each grade level—4, 5, 6, 7, and 8—provided 
data for the study. In all, 114 children pora 
pleted the printing task, but 14 data gr 
were discarded because the blank spaces thai 
set apart trials had been omitted. 


Procedure 

Subjects were run in groups of four ih 
eight. Two experimenters were present at so 
session, which expedited accurate timing ing 
trials and supervision of the number pane 
activity. All subjects were run during a eee 
period. When a group had completed the their 
they were asked not to discuss it with the 
friends until the experimenters had left ne 
school. This procedure appears to have FA 
cessfully precluded advance knowledge of 
task and resultant practice. that 

A study by Wasserman (1951) shows ffect 
degree of motivation has a significant nade, 
upon inhibitory potential, An effcrt was Phe 
therefore, to secure reasonable motivation. e i 
subjects were told that their performan n che 
making “upside-down numbers” would * ople 
experimenters “something about how p task 
learn,” but they were assured that the wi 
Was not a test. This procedure, combine eare! 
informal chatting to secure rapport, @PP ith- 
to be successful in securing motivation 
out anxiety, 


RESULTS AND DrscussIOoN 


5 num” 
The mean number of inverted ! 


bers printed in Trial 1 was exactly 
same for good and poor readers. F 
shown in Table 1, which presents ™ 
responses on selected prerest an 
rest trials. Inspection of Table u 
shows that a plotted acquisition tle 
would show limited positive acct te 
tion for the good readers and neglé pe 
acceleration for the poor readers: teve" 
implication appears to be that wh@ ers 
skill was developed by the poor w tive 
Was nullified by accumulating 1°%% „ye 
inhibition. The postrest results ‘or 
Classic, in that on Trial 13 good and Eth 
readers again performed almost 10° pe 
cally; by the final trial (Trial 16)» aih 
poor readers’ performance was f the 
beginning to diverge below that ° 
good readers, 


js ÍS 


I 


Reactive ĪNRIBITION AND READING SKILL 


TABLE 1 


MEAN RESPONSES ON SELECTED TRIMS 


Reading 
level - 1 g o r 8 
> 
Good 9.98 10.84 114d 
Poor 9.98 10.28 10.64 


ee hen the prerest and the postrest 
i ials were considered separately, it was 
enaa that there were no significant be- 
Ween-trial differences in digits produced 
(ie, Trial 1 did not differ from Trial 2; 
mo 2 did not differ from Trial 3, etc.). 
moet only last prerest (Trial 12) 
s rst pcstrest (Trial 13) trial results 
re considered in subsequent analyses. 

is nes responses (digits produced) on 
rere, 12 and 13 by good and by poor 
in Tah at each grade level are presented 
sis T le 2. A repeated measures analy- 
a a variance (Edwards, 1950) of 
Pe Produced on Trials 12 and 13 is 
nif marized in Table 3. There is sig- 
icant grade level difference (p<.01) 
the higher the grade level, the greater 
he number of digits produced tends to 
a ee Table 2). As expected, there is 
ed significant between-trial differ- 
reti (Ż<.001); within the present theo- 
o cal framework, the gain from prerest 
Postrest performance (see Table 2) 


TABLE 2 


Meany 
EAN Responses on Last PREREST AND 
First Postrest TRIALS 


a Trial 12 Trials 

s All All 
Good Poor sub- Good Poor sub- 

i jects jects 
e > ê: 

4 Dor 

5 s1 73 77 89 104 97 

6 87 103 95 11 14.5 128 

7 135 194 12 169 140 15.5 

8 128 98 «113 153 15.0 15.2 
AN gra 144 137 141 17.9 16.5 17.2 
ios jo, 108 140 141 141 


12 Rest 13 16 
1148 11.5 — 14.02 13.54 
10.38 10.1 s 14.08 13.02 


demonstrates the dissipation of reactive 
inhibition during rest. 

There is not a significant difference 
between reading levels; that is, when 
overall performance is considered good 
readers do not differ from poor readers. 
However, poor readers do differ from 
good readers in the gain in digits pro- 
duced after rest. This finding is indi- 
cated by the significant Trial x Reading 
Level interaction (p < .01) and demon- 
strated in Table 2. If the prerest and 
postrest performances of good and poor 
readers were plotted, the slopes would 
differ significantly; that is, the per- 
formance of the poor readers increased 
more sharply than that of the good read- 
ers. The implication is that the differ- 
ence in rate of increase was due to the 
dissipation of more reactive inhibition 
by the poor readers. The hypothesis 


TABLE 3 


ANALYSIS OF VARIANCE OF Last PREREST 
AND First Postrest TRIALS 


Source df MS F 
Grade Level (G) 4 276.1875 11.425* 
Reading Level (R) 1 22.4450 — 
GXR 4 50.5113 2.099 
Subjects/ Groups 90 24.0683 4.128* 
Trials (T) 1 528.1250 90.578* 
TxG 4 6.5625 1.126 
TXR 1 26.6450 4.570** 
TXGXR 4 4.3263 = 

90 5.8306 


Subjects x T, Groups 


* p< 001. 
p< Ol. 
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that good readers generate less reactive 
inhibition than poor readers in a given 
:eriod of time is, therefore, accepted on 
the basis of the present data. 

The results of the present study sup- 
pert Lynn’s (1960) finding that reactive 
inhibition appears to be associated with 
reading attainment. This may, in turn, 
lend support to the notion that, at least 
in the early stages, certain school learn- 
ing (ie., simple addition and reading) 
takes place by instrumental condition- 
ing (Peel, 1956). Whatever the theo- 
retical framework, the relationship 
demonstrated by the Present study ap- 
pears to hold promise for further investi- 
gations. It would be interesting, for ex- 
ample, to substitute good and poor 
achievers in, say, arithmetic, spelling, or 
handwriting for the good and poor read- 


ers of the - If this were 


n in learning 
Once this role is 
Possible to design 
ve implications for reme- 


Wayne Otto anv Ropert C. FREDRICKS 


hibition in children. In addition, the 
need to control the grade level (chrono- 
logical age) of subjects in future studies 
is made clear. The details of implement- 
ing the number printing task are p 
sented in the hope that the present m 
will be a useful tool in future researc 
studies. 
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THE PARENT-CHILD RESEMBLANCE 
IN INTELLIGENCE? 


MARJORIE P. HONZIK 


Institute oj Human Development 
University of Calijornia, Berkeley 


In a representative urban sample of 248 children, years of schooling of 
both parents showed an increasing relationship to their son’s and daugh- 
ter’s IQs between 21 mo. and 15 yr. The parent-child correlation was 
observable and became statistically significant for girls by 3 yr. but not 
until 5 yr. for boys. Earlier parent-daughter resemblance was also noted 
when ratings of mother’s intelligence and social status were correlated 
with‘the children’s scores. Siblings’ IQs yielded comparable sex differences 
in relation to parents’ education. This finding was further confirmed in 
the correlations of the IQs of a 2nd generation sample with the IQs of 
the parent in the original group at age 15 yr. A sex difference in rate of 


mental growth is suggested as the major determinant of these results. 


i differences in mental test per- 
Mites are not often significant when 
Mi noe scores of boys and girls on 
in i ard tests are compared, but hidden 
ie ese averages may be changing rates 
FP ag growth which are of consider- 
t interest to all who are charged with 
na ee of children. In the present 
ih a the concern is with sex differences 
child rate of increase in the parent- 
ier resemblance in ability occurring 
uring childhood. 
an a first study of parent-child resem- 
ea in intelligence, Jones (1928) re- 
ih rted a correlation of .50 between the 
telligence test scores of parents and 
e children. More recently, reports 
om longitudinal investigations have 
ARa that little or no resemblance 
and S between the abilities of parents 
Shi of their infants, but that a relation- 
the develops late in the second, or in 
in third, year of life and increases dur- 
“a childhood until a correlation ranging 
iom .25 to .75, with an average of .50, 
Teached (Bayley & Jones 1937; 


1h; 

i This study was supported in part by a 

Sta from the Ford Foundation and a United 

06238. public Health Service grant, No. MH- 
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Honzik, 1940, 1957; Kagan & Moss, 
1959), It was thought at first that this 
increasing resemblance was the result of 
environmental influence. However, 
Skodak and Skeels’ (1949) longitudinal 
study of adopted children reported a 
similar age change between the abilities 
of adopted children and their true par- 
ents who placed the children for adop- 
tion during the first months of life, but 
no significant relationship between these 
same adopted children’s IQs and the 
abilities of their adopting parents. This 
significant finding points to a genetic 
basis for at least some of this relation- 
ship. 

The question to which this paper is 
addressed is the extent to which there is 
a sex difference in these relationships. 
Higher mother-child than father-child 
coefficients would suggest the importance 
of environmental stimulation; higher 
same-sex correlations might be the result 
of genetic factors or differential stimula- 
tion of boys and girls by their parents. 
Higher opposite-sex correlations might 
reflect sex linkage or environmental 
effects. Differences in the age at which 
boys’ and girls’ IQs correlate signifi- 
cantly with measures of parental ability 
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would suggest a sex difference in the 
rate of mental growth. a. 
Increasing parent-child similarities in 
ability are reported for a California 
sample by Bayley (1954), an Ohio 
sample by Kagan and Moss (1959), 
and a London sample by Hindley 
(1962). In these three investigations 
results are given for boys and girls 
separately, permitting an analysis of sex 
differences. Bayley (1954) concluded 
for the 28 boys and 28 girls in the 
Berkeley Growth Study: 
there appears to be little sex difference in the 
parent-child relationships in mental ability, in 
this group, although the girls’ scores are of- 


tener than the boys’ significantly correlated 
with parental status [p. 6]. 


Kagan and Moss (1959) reported, for 
59 boys and 40 girls, product-moment 
correlations between the child’s Stan- 
ford-Binet IQ at 3, 6, and 10 years and 
(a) parental education, and (b) parental 
Otis IQ. In this Study maternal edy- 
cation (years of schooling 
of both sons and daughte 


girls but not until 6 
years for the boys, 


In the British study 
significant sex differen 
of the child’s test sco 
cupation for 40 boys and 37 girls tested 
on the Griffiths scales at 6 months and 
1/4 years, and the Stanford-Binet at 3 
and 5 years. For the girls, a relation- 
ship between social class and child’s IQ 
is noted at 134 years which becomes 
statistically significant at age 3 years 
(p < .001); but for boys, the relation- 
ship only begins to appear at 5 years 
(p < 10). This finding is in line with 
Kagan’s report of higher correlations 


Hindley reports a 
ce in the relation 
re to father’s oc- 


between the daughter’s IQ and parental 
education, especially at 3 years. By 
ever, Kagan also presents results iene 
the Otis IQ as the parental abil: y 
measure showing a slightly higher 
father-son than father-daughter aan 
tion in IQ at 3 years which does a 
this trend of an earlier appearance of a 
parent-child similarity in ability in gir 
than in boys, ai 

In summary, two of these three long 
tudinal studies report sex difference i 
the parent-child relationship in pained 
(whether the parent’s ability is aie 
ured by occupational status, years snl 
Schooling, or IQ) which are ger 
but not entirely consistent and w nat 
will be of interest to explore 1r: de 
another developmental study—the GU 
ance Study. 


SAMPLE AND PROCEDURE 


ildren 

The Guidance Study sample of 248 ia 
was selected from the Birth cernent chil- 
istry and is a representative sample of thi nonth 
dren born in Berkeley during an 1B 
Period (from January 1, 1928, to J jnto 
1929). This urban sample was divide n the 
two matched groups of 124 children © chil- 
asis of socioeconomic factors before the ent 
dren came to the institute for their first i ren 
test at 21 months. One of these groups | the 
ferred to as the Guidance group because E 
program of intensive interviewing of E op 
and children, The second, or Control ià age 
was measured and tested at comparab eviews 
levels but there were no intensive inter 
until the children were 17 years old ( th 
lane, 1938). In addition to the 21m wpnildre? 
mental tests were administered to ee years 
in both groups at ages 3, 314, 4, and >? 7 o 
at yearly intervals until 10 years; 2 pildre® 
13 years; and at 14 or 15 years. The s scales 
were tested on the California Prescho nay, i 
during the first 5 years (Honzik, bas and 
1916 revision of the Stanford-Binet 37 stan 
7 years, and Form L or M of the 193 
ford Revision at subsequent ages. 


y 
TUD 

RESULTS FOR THE GUIDANCE S 
SUBJECTS 


f 
«on 0 
Correlations between the aenean pool” 
the mother (number of years of $ 
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ing) and the IQs of sons and daughters 
are presented for successive ages in 
Table 1. For over 100 cases a slight 
mother-daughter correlation is notice- 
able at 21 months which becomes statis- 
Ucally significant at age 314 years. In 
Contrast, with an equally sizable N, 
the mother-son correlation is positive at 
i 3% years (r = .24), but does not 
Ome significant at the .01 level until 5 
years, Similarly, the correlation between 
the father’s education and his daughter's 
is significant at 3 (r = .32) but it is 
ede 5 yeais that the boy’s IQ is sig- 
Ga related to his father’s educa- 
_, us his sex difference in the age level 
tani the parent-child resemblance 
Ee es significant is clear, At ages 21 
Stee 3 years, and 4 yea rs, these sex 
the ences are statistically significant at 
( 05 level or better. A further finding 
oe 1) is the increase in parent- 
And Pree until age 14-15 years. 
ie us is true for the father-son as 
inet as the mother-son coefficients. This 
ie ee either (a) continued en- 
Mental influence or (b) maturing 
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of mental functions in boys until middle 


adolescence. Consideration of the 
Skodak-Skeels results points to the latter 
interpretation. 


Table 1 gives the results for the com- 
bined Guidance and Control groups. 
Correlations were also computed for 
these two subgroups, each of which is 
comparable in size with those used in 
previous longitudinal studies reporting 
sex differences. In both subsamples, 
Guidance and Control groups, the par- 
ent-child correlations became positive 
and statistically significant at an earlier 
age for girls than for boys. 

Since both the mother’s and father’s 
education was significantly related to 
the daughter's IQ before the son’s, it 
was of interest to determine the com- 
bined effect of the father’s and mother’s 
contribution by computing a multiple R 
between the boy’s and girl’s scores and 
their parents’ education (see Table 1). 
In this sample the number of years of 
schooling of the mothers and fathers cor- 
relates to the extent of an r of .74 
(Atherton, 1962). This r of .74 is suf- 


TABLE 1 


CORRELATIONS BETWEEN THE C1ILD’S IQ AND PARENTAL EDUCATION FOR 
GUIDANCE STUDY SUBJECTS 


Mother’s Educa- 


Father’s Educa- Parental Educa- 


Age in cases tion x Child’ IQ tion x Child's IQ tion x Child’s IQ 
Years E — Boys’ Girls’ Boys’ Girls’ Boy’ Girls’ 
Boys Girls r r r r R R 
eee 
134 109 114 00 AT 00 
iz 110 113 .00 d 12 
Pig 105 109 24 24 
5 105 107 a7 bt 
> 101 109 40** Al 
7 102 112 25 n 
8 101 107 34t 36% 
9 94 104 37** sdi 
10 93 102 Are a 
iz 95 102 31 32 
or 13 92 100 42** 42%% 
“oris 83 85 Agee aor 
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ficiently high so that the multiple Rs are 
not markedly higher than the zero-order 
rs. However, the trend is clear. The 
parent-daughter resemblance (R = .33) 
is significant at the .01 level at 3 years, 
but the parent-son correlations do not 
become significant to this degree until 
age 5. 

Parents’ education, or years of school- 
ing, is at best a rough measure of their 
ability. A second approximation, or in- 
direct measure of paternal ability, is 
Warner’s (Warner, Meeker, & Eels, 
1949) index of status characteristics 
of the family at the birth of the child. 
This index which reflects paternal in- 
telligence (since it is based on: fathers’ 
occupation, source of income, house 
type, and dwelling area), correlates .64 
with fathers’ and .62 with mothers? edu- 
cation (Atherton, 1962). The daugh- 
ter’s IQ is significantly correlated with 
this index at age 3 (7 = .27), but it is 
not until 5 years that this relation is 
significant at the .01 level in boys 
(r= 37). At 3 and 4 years the sex 
differences in the coefficients are signifi- 
cant at the .05 and .07 levels, respec- 
tively (see Figure 1). This finding is 
very similar to that reported by Hind- 
ley, who found a highly significant re- 
lationship between the father’s occupa- 
tional rating and his daughter’s IQ at 
3 years (p < .001) but a significance 
level of .10 was not reached for the sons 
until 5 years. 

Estimates of the mother’s intelligence 
are still another measure of maternal 
ability which have been related to the 
children’s test performance, The intel- 
ligence of the mothers of the subjects in 
the Guidance group was rated 
members of the staff on a 7-point scale 
after a series of interviews and observa- 
tions of the mother and her child begin- 
ning at 21 months (Macfarlane, 1938). 
The interrater agreement for these rat- 
ings was .68. This rating correlated .73 


by two 
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4 


wl. Ñ s om, 
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Correlotion Coetticient 


a 15 
234 5 6 


wi 8 t 
e 


Bs 108 109 104 10 ior s 


Gils a 109 ia 103 100 
SSrgaticost at me 0% tevsi 


Guidance Group $ 
St Sigruticonn ot me O1 tevet 3 


Contro! GrouP 


ip of 
Fic. 1. Age changes in the relationship 
Warner’s “index of status characteristics ssive 
1Qs of the sons and daughters at soio 
ages. (Combined Guidance and 
groups.) 


with the mother’s education. The ns 
age of the two ratings has been nta 
related with the boy’s and girl’s m (502 
test scores at successive age levels 

Figure 2). The trend observed for 
other indexes of parental ability ild re- 
again, namely, that the mother-chi 


seen 


Ratings of Mother's Intelligence 


60 X Daughter's 1Q 


Correlation Coefficient 


2345 6 7 58 9 00 1 as 

Age in Yeors an a 
fen co 60 ss y 0 53 a 
ms sit 8 8 E 


4 (umbar of Cones 
ee hMMicent of the 05 teval wea 
Sig 


Pi as sees y ratin 
Fic. 2. Age changes in the relation © aus 
of mother’s intelligence to the sona eee gro" 
ters IQs at successive ages. (Guidan 

only.) 
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semblance in “intelligence” occurs at 
an earlier age for girls than for boys. 
Two rough and indirect measures of 
fatners’ mental ability (education and 
Warner's index of status characteris- 
ties) and two of mothers’ (education 
and ratings of intelligence) show a sig- 
nificant correlation with the tested in- 
telligence of daughters by the age of 3 
tay but not until 4 or 5 years for their 
ate This finding, which is in accord 
her _that reported by Hindley (1962) 
“i a part by Kagan and Moss (1959) 
2 Wo other longitudinal samples, sug- 
Pre that individual differences in men- 
a! become stabilized earlier in 
cee an in boys. This sex difference is 
and gi but is statistically significant 
ee appears in spite of the use of 
aid approximations of parental ability 
desi Scores on mental tests which were 
mean to be equally difficult for boys 
girls (cf, Terman & Merrill, 1937, 
P. 34), 
tong the results for the Guidance 
Fn z subjects are significant, they are 
fndin exact agreement with some of the 
valid E of Kagan and Bayley so that 
a E ae in other samples of parents 
ae ildren should be considered. Data 
available for two more groups in 
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the Guidance Study. These are the (a) 
siblings and (b) children of the Guid- 
ance Study subjects. These additional 
samples are large but were not so care- 
fully selected to be representative of an 
urban population as were the Guidance 
Study subjects. This is especially true 
for the sibling group which in some in- 
stances includes more-than one sibling 
in a family and where of the 205 tests 
considered, 67 were retests. Thus the 
sibling sample is not a longitudinal 
sample, nor is the second generation 
sampling of Guidance Study subjects’ 
children who ranged in age from 1 to 10 
years when they came in for a single 
mental test. 


RESULTS FOR THE SIBLINGS OF THE 
GUIDANCE STUDY SUBJECTS 


The subjects’ siblings were examined 
on the same tests as the subjects dur- 
ing the years that the subjects were 
coming in for tests, measurements, and 
interviews at yearly and half-yearly in- 
tervals. Table 2 presents the correlations 
between the sibling’s IQ and the 
mother’s and father’s education. These 
coefficients are based on the same pa- 
rental measures as for the subject but 


TABLE 2 


C 
ORRELATIONS BETWEEN THE SIBLINGS’ 
FATHERS’ 


MENTAL Test SCORES? AND Trem MOTHERS’ AND 


EDUCATION 


Mothers’ Education X 


Age range Mental Test Scores of: 


Fathers’ Education X 
Mental Test Scores of: 


ìn years Brothers Sisters Brothers Sisters 
N r N r N r N r 
134-314 16 12 21  .69** 16 19 21 28 
T 26 05 27 53 26 09 27 76% 
Pe 33 -20 20  .54* 34  35* 20 StS 
Ps 27 34 17  61** 27 39% 17 .79** 
Or the Che tests used were those given to the subjects at the same age level, either the California Preschool scale 


Stanford Revision, Form L 
“5 < .05 or better. 
01 or better. 
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the parental measures are now consid- 
ered in relation to the test scores of a 
subject’s brother or sister. An approxi- 
mately equal number of siblings of the 
same and opposite sex as the subject was 
included. The results (see Table 2) are 
similar to those found for the Guidance 
Study subjects (see Table 1) and 
strengthen the probability that parent- 
child resemblance in ability occurs ear- 
lier in girls than boys. The correlations 
between the brother’s IQ and his par- 
ent’s years of schooling show a gradual 
increase with age. These correlations 
become significant at the .05 level at 
age 6 years and after. In this sibling 
sample the girl’s (sister’s) IQ is highly 
correlated with parental education dur- 
ing the preschool years. This finding is 
in line with the coefficients reported by 
Kagan and Moss. 


RESULTS FoR THE SECOND GENERATION 
CHILDREN oF THE Gumance Srupy 
SUBJECTS 


The children of the Guidance Study 
subjects (a second generation sample) 
were included in a testing program when 
uidance subjects) 
were seen in a follow-up study at 30 
years (between 1958-61), 
mental tests were ad 
second generation as 
the same age. Thus, 
aged 3 and 6 years 
follow up would be 
the California Presc 
Stanford Revision. 
generation sample, were n 
the follow up. The lates 
which the Stanford Revision was ad- 
ministered to the subjects was at 14 or 
15 years so the subjects’ IQs at this age 
were correlated with the scores of their 
sons and daughters (second generation) 
at whatever age the children had at. 
tained when their parents were 30 years 
old. The correlations between the IQs 


ot retested in 
t age level at 


of the subjects’ children and those of the 
subjects are shown in Table 3. : 

For the second generation of ciigren, 
the parent-child correlations are an 
for the girls than the boys at 3 ee 
years, but at 5 years significantly hig ‘ 
correlations are obtained for the i 
These findings agree with the pe 
reported for the first generation stu 4 
but are not as consistent or significant. 


DISCUSSION 


A question asked at tke beginning of 
this paper was the extent to which han 
mother-child resemblance is greater t Jli- 
the father-child resemblance in ar 
gence. Bayley and Kagan both ant 
higher mother-child than EO ia 
relationships which led Kagan to may 
clude, “environmental pressures min- 
play an important role in the Oera e 
ing of the child’s IQ score. a 
present study, for a much larger een 
paternal education correlated Meie 
than maternal education with ross- 
daughter’s IQ at all ages. Higher 4 - 
Sex correlations were also obtaine the 
tween the mother’s education ee 
son’s IQ. This finding was age ee 
two subsamples (Guidance and co 


TABLE 3 


yas 
PAR 
CORRELATIONS BETWEEN tue 14-15 Y TEST 
OF THE SUBJECTS AND THE MENTAL 


“0! n 3 HILDREN 
Scores or Tuem C S 


x: 
jects? IQs at 14-15 Years * 
Children’s __ Subisets 1Qsa a 


atl 
eI 
age in Son’s IQ Daughter — 


: ae Á amaer r 
years N r N 

35 
2 20 16 21 23 
3 28 06 24 as* 
4 23 33 19 21 
5 26 52 21 39 
6 15 55* ae 
7-10 33 478% 22 ser 


Oa, ee rx —— 
x? S 05 or better. 
b < 01 or better. 
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groups). The results for the siblings 
of the Guidance Study subjects did not 
Clarify these discrepancies since the re- 
lationships in this sample were unusually 
high for the sisters. The higher opposite- 
Sex relationships obtained for the Guid- 
ance Study subjects is an interesting 
finding but one which has not been 
found in other samples. 

The earlier appearance of a parent- 
child resemblance in ability in girls is 
— although the sex difference is 
a past as to preclude instances of 
fee aR sin this trend. One explanation 
ia finding may be that the pre- 
ee Pai girl is more cooperative and 
bo in ed in the test situation than the 
he hm this age period, but this greater 
fee on and control may be a re- 
= ee: of generally earlier maturing of 
tee ae function in girls. It is probable 
Sats e maturing of the central nervous 

m proceeds more slowly in the male 


t 
; han the female as is true for other 


pects of physical growth (e.g. height). 
ae slight sex difference in maturation 
— aptit then account for the sex dif- 
chila in the age at which the parent- 
come. resemblance in intelligence be- 
se S visible. There is other evidence 
nE Cc difference in the pattern of 
son A growth. Bradway and Thomp- 
signifi 962) report that males show a 
OL} anny greater gain in TQ Cf < 
Mk ter adolescence than do females. 
gest 3 from this and other studies sug- 
that it is only in longitudinal studies 

a differences in mental growth 
€ seen in their full perspective. In 
slight words, when sex differences are 
ion or related to slowly maturing func- 
bee it may be only over a prolonged 
Period that they become noticeable 

a Significant degree. 
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i OUT-OF-CLASS ACHIEVEMENT IN 
GIFTED SCIENCE STUDENTS: ` 


EDWIN A. LOCKE 
Cornell University 


The 47 variables measuring intellectual abilities, personality traits, per- 
sonal habits, and demographic characteristics were intercorrelated for a 
group of 112 gifted science students and developed into 11 factor index 


Scores, 


obtained relationships. 


A previous paper by Locke (1963) 
described the development of achieve- 
ment criteria for a select group of high 
school science students, Two orthogonal 
criterion factors were isolated. The first 
factor contained course grades and sum- 
mary teacher ratings each in two differ- 
ent situations and will be referred to as 
“classroom achievement,” as it involves 
accomplishments jn assigned school 
work and classroom behavior, 
ond factor contai 


amount of indep 


out- 
involves 
conven- 


of-class achievement,” as it 
accomplishments unrelated to 
tional school requirements,? 


1 The research here w: 
fulfillment of the degr 
Cornell University. Gratitude is expressed to 
Patricia C. Smith of Cornell University who 
directed the thesis, to Smith and Lorne M, 
Kendall of Cornell whose criticisms of this 
paper were most helpful, to the late T. R. Niel- 
sen of Cornell who directed the Cornell Na- 
tional Science Foundation program and whose 
cooperation and help made this study possible, 
and finally to Matilda Kejner, Cornel] Univer- 
sity (Visiting Professor, University of Cor- 
doba, Cordoba, Argentina), who was responsi- 
ble for the scoring of the originality measures, 

2In the previous paper (Locke, 1963) the 


as completed in partial 
ee of Master of Arts, 


These were correlated with classroom and out-of-class achieve- 
ment factors developed in an earlier study. 


were found to be most highly related to 
school and city sizë and originality most h 
achievement, There were considerable diffe 


Vocabulary and self-control 
classroom achievement, and 
ighly related to out-of-class 
rences between sexes iù the 


This paper reports the results es 
testing program aimed at finding anf 
correlates of these two aeey 
factors. The types of variables a 
included intellectual, personality, card 
graphic, and personal habit ed 
The paper also has some methodolog! in 
implications which are brought 0u Its. 
the course of the discussion of rest 


METHOD 

Subjects high 
1 

The subjects tested consisted of 122 P 
school juniors and seniors (73 boys s a 
girls) attending a Cornell summer SE the 
vanced science training program une dation: 
auspices of the National Science Foun a f 
he subjects were highly selected in ter sexes 
both aptitude and motivation. i 
averaged above the ninety-seventh 


onal 
oe 
sexes 
tained 


Tests and Measures 


The name, 


ie! 
thesi?! 

description, and hyp? 
factor for each 


test are given below: 


d 
wor! 
1. Advanced Vocabulary—Select the 


5 
s f ba 
classroom and out-of-class achievement “self 
were referred to as “structured” an 
initiated” achievement, respectively. 
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that means the same from four alternatives 
(verbal; French, 1954). 

2. Wide Range Vocabulary—Select the word 
that means the same from five alternatives 
(v.rbal; French, 1954). 

3. Verbal Comprehension—Select the word 
that means the same from five alternatives 
(verbal; Guilford & Zimmerman, 1956). 

Ma Suffixes—Write as many words as possi- 

e ending with a certain suffix (word fluency ; 
French, 1954). 

Ba Prefixes—Write as many words as possi- 
ae beginning with a certain prefix (word 

uency; French, 1954). 
bie’ a of as many ideas as possi- 
Pr about a given topic (ideational fluency; 

ench, 1954), 
me Theme—Write a theme about a given 

Pic (ideational fluency; French, 1954). 
eon Category—List as many things as 
E that belong to a certain category 

a ena fluency; French, 1954). 
cone o seguents (obvious)—Write as many 
untines foe as possible for a number of sit- 
field ns (ideational fluency ; Christensen, Merri- 

i » & Guilford, 1958). 
tea aE Test of Creative Ability (Form B, 
for a )—Think of as many uses as possible 
sized number of objects. Quality was empha- 
scored (ido gey but only quantity Rn 
Undated), ational fluency; Harris & Simberg, 
heer oe Test of Creative Ability (Form A, 
ble wh —Think of as many reasons as possi- 
uenc X certain facts could be true (ideational 

12 eee & Simberg, undated). 

Part, Vv Test of Creative Ability (Form B, 
or a )—Think of as many uses as possible 
Hie bees of objects (ideational fluency ; 

FERo, Simberg, undated). e 
ties z ategories test—Give as many similari- 
or a Possible between a number of objects 
similari 5 (Score was the total number of 
` ished ities given; creative ability; unpub- 

14 , author). 
simil; Associational Fluency I—Write words 
Sen a Mm meaning to other words (Christen- 

te pouilford, 1959). 
sente Expressional Fluency—Write as many 
wit] nces as possible using words that begin 
1959) tain letters (Christensen & Guilford, 


fi p Pertinent Questions—Ask as many as 

a ny questions that should be considered in 

Ber, mber of situations (conceptual foresight; 
ger, Merrifield, & Guilford, 1960). 

numpa te Premises—Indicate whether a 

(deq cr of syllogisms are “true” or “false 
uction; French, 1954). 


18. Word Squares—Fill in the missing word 
in a word matrix from a list of words, in 
order to fulfill a certain relationship between 
the words (deduction; French, 1954).3 

19. Letter Grouping—Indicate which group 
of four letters does not follow the same rule 
as the other three (induction; French, 1954). 

20. Marks—Put a mark in the proper space 
in the sixth row of a matrix according to the 
rule used in the first five rows (induction; 
French, 1954). 

21. Ship Destination—Calculate the distance 
between two points (“ship” and “port”) in a 
matrix in a number of situations given certain 
rules about how to take into account wind, 
current, and heading (general reasoning; 
Christensen & Guilford, 1956). 

22. Special Problems—Solve a number of 
problems thought to require ingenuity (crea- 
tive reasoning; Smith & Smith, 1956). 

23. General Reasoning (Guilford & Zimmer- 
man, 1956). 

24, Bennett Mechanical Comprehension Test 
(Form CC). 

25. Minnesota Clerical Test 
text). 

26. SRT Scale—Paired comparison adjective 
check list (scientific research temperament; 
Kosinar, 1960). 

27-30. Gordon Personal _ Profile—Yields 
measures of Ascendancy, Responsibility, Emo- 
tional Stability, and Sociability. 

31-34. Gordon Personal Inventory—Yields 
measures of Cautiousness, Original Thinking, 
Personal Relations, and Vigor. 

The Minnesota Clerical Test was given with 
no time limit, and the amount of time spent 
on it was taken as a measure of speed. The 
total scores from the Gordon Profile and In- 
ventory were eliminated to avoid spurious cor- 
relations between the totals and the subscores. 

For the AC Test of Creative Ability (Form 
B, Part V) quality instructions were given to 
see whether this would affect the correlations 
between this and the other jdeational fluency 
measures. Both forms of Part V of the AC 
test were also scored for Originality. These 
scores were obtained by weighting each re- 
sponse according to its frequency in the group. 
the more infrequent responses being given 
more weight. These weights were summed for 
all responses and divided by the number of 


(speed; see 


3A third deduction test from the French kit 
was eliminated due to extreme restriction of 
range. Over 50% of the subjects obtained 
perfect scores on this test. 
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categories used by the subject to attempt to 
control for fluency. These average category 
originality scores will be referred to as Origi- 
nality A and B. 

The following 11 additional measures were 
also obtained for each subject from question- 
naires: 

35. Number of hours per week spent on 
independent study at high school. 


36. Number of unassigned books read per 
month at high school. 


37. Socioeconomic status based on a crude 
rating of the father’s job level on a 4-point 
scale, 


38. Number of science courtes offered by 
each high school. 

39. Size of home city. 

40. The size of high school senior class, 

41-45. Opportunities for research based on 
five questions asking the subject how much 


time and opportunity he had for independent 
work and research at high school. 


RESULTS 


The above 45 Variables were inter- 
correlated using all 122 subjects. The 
intercorrelation matrices were not com- 


the number of vari- 


i d be considerable 
sampling and random error in such 


matrices. However, in an earlier ana- 
lysis of these data (Locke, 1962), using 
a slightly different procedure, the factor 
structures were found to be quite similar 
for the two sexes. The resulting matrix 
was factor analyzed using the centroid 
method and rotated using the quartimax 
method on a Burroughs 220 computer, 
The Originality measures were not in- 
cluded in this analysis since they were 
found not to be completely independent 
of the fluency scores for the same tests, 
Twelve factors were extracted in the 
analysis, All loadings of .30 or greater 
(with two exceptions where loadings 
below .30 are shown) are shown below 
for each factor. 


Factor I: Ideational fluency 


Consequences (obvious) 668 
AC (Form B, Part V) g7 
Categories oon 7 
Topics 63 d 
AC (Form A, Part II) u 
AC (Form A, Part V) mee 
Thing zategory 99 4 
Pertinent questions 54 è 
Theme 46 å 
Associationa] fluency 40 


All the open-ended tests where scores 
were calculated from frequency of id 
sponse loaded highest on this factor With 
the exceptions of expressional piene 
suffixes, and prefixes which perhaps ye 
more strictly to do with words tha 
with ideas, ` 


Factor If; Vocabulary 


Verbal comprchension 86 
Wide range vocabulary Bt 4 
Advanced vocabulary l 4 
Suffixes ae 


actor 
This is clearly a yocabulary fact 


5 : $ c 
with a small loading for a word fluency 
test. 


Factor III: General reasoning 


4 
Special problems ae 4 
General Reasoning J 4 
Ship Destination 63 4 
False Premises g0 
Bennett (Form EG) H 
Marks p 
Original thinking £ 


; n 
The variables having high loadings n, 
this factor all have to do with oe 
Problems of a mathematical or Bed 
nature. Both the General Rea of 
and Ship Destination tests have „eral 
found previously to load on a Bayil- 
reasoning factor (Christensen & „man, 
ford, 1956; Guilford & Zimmer 
ee igher 0 
* Denotes that this variable loaded high will 


: n 
this factor than any other. This notatio 
mean the same for all other factors. 
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1956). The reasoning and letter group- 
Ing tests surprisingly did not load on 
this factor. 


ractor IV: Self-control versus impulsiveness 
Responsibility 68 4 
Cautiousness 684 
SRT —.654 
Personal relations 594 
Emotional stability 504 


This is a personality factor with high 
Positive scores being associated with 
jall-deseriptions emphasizing responsi- 
oe cautious, controlled, and stable 
amie and low scores indicating 
mpulsive, imaginative behavior and lack 
of self-discipline. 


Factor V: School and city size 


Class size 894 
City size 844 
Number of science courses 564 
Research opportunities—S 33 


a three variables loading highest 
aie is factor all have to do with the 
x, and perhaps quality (i.e., number 
: Courses offered) of the place where 
ach subject went to high school. 


Factor VI: Slowness 
Minnesota Clerical (time) 65% 
etter grouping — 584 
ae — 40 
Bennett (Form CC) 33 
Associational Fluency =2l 
Expressional Fluency =F 


5 People scoring high on this factor 
Gan a long time on the Minnesota 

erical Test and did poorly on the 
Nductive Reasoning tests.’ The Bennett 


isis Should be mentioned that the induction 
ere Were harder to finish for this group than 
few jo of the other tests. This is one of the 
to eine on which no subject came even close 
Thi taining a perfect score or even finishing. 

İS suggests that a considerable speed factor 


Was a 
Present in the scores. 


Mechanical Comprehension Test was 
given as a “take home” test with no 
time limit so the amount of time spent 
may have entered into the scores; this 
might explain its positive loading. The 
Associational Fluency and Expressional 
Fluency tests, both measures of “rate of 
word output”, were timed and this could 
explain their negative loadings. 


Factor VII: Research opportunities 


Research opportunitics—1 68 + 
Research opportunities—5 564 
Research opportunities—2 544 
Research opportunities—3 30 


This is clearly a research opportuni- 
ties factor. Questions 1 and 2 concerned 
relations with teachers and their ability 
and willingness to help with independent 
research. Question 5 asked about the 
adequacy of library and laboratory fa- 
cilities in the subject’s school and home 


town. 


Factor VIII: Orientation toward people 


814 


Ascendancy 
644 


Sociability 


Both the ascendancy and sociability 
measures are concerned with liking for 


other people and groups, thus this fac- 
tor was named “Orientation toward 


people.” 
Factor IX: Creative energy 
Original thinking 614 


Vigor 564 


Since this factor suggests a combina- 
tion of originality and motivation or 
energy, it was named “Creative energy.” 


Factor X: Independence versus socioeconomic 


status 
Socioeconomic status — 394 
Hours on independent study ay 
Ship Destination —.29 
Number of unassigned books 
Py k 


read 
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A high score on this factor seems in- 
dicative of independence, namely read- 
ing unassigned books and spending time 
doing unassigned high school work. Low 
scores indicate high socioeconomic sta- 
tus and general reasoning ability. This 
suggests that the subjects in this pro- 
gram who were from the lower class 
families (actually in this sample nearly 
all subjects? fathers were white collar 
so the range was between middle and 
upper-middle or upper classes), did more 
work on their own, This may reflect 
more drive on the part of these students 
as compared to those students with 
higher class backgrounds, 

The factor is admittedly not a clear 


one, since two of the loadings are below 
30, 


Factor XI: ? 
D-3 


~ 40 
Research opportunities—3 


40% 


This factor is not easily interpretable, 
The research opportunity question 3 
concerned amount of parental encour- 
agement for research, 


Factor XII: Speed fluency 


Research Opportunities—4 


s 444 
Thing Category 


39 


This appears to be a speed factor, 
The research Opportunity—4 question 
concerned the amount of time available 
for extra work; the Thing Category 
test, like the other fluency tests, in- 
volved giving as many ideas as possible 
about a topic in a given amount of time. 
Thus the factor seems to involve a 
combination of speed and high output 
of verbal material. 

The three or four best measures of 
each factor were summed to form factor 
index scores after converting all raw 
scores to z scores. In all but one case 
(involving highly discrepant loadings of 


different variables in the same factor) 
all measures were weighted equally m 
forming index scores. The use of unit 
weights in the case where factor load- 
ings do not vary too widely has some 
advantage over weighting by factor load- 
ings, since the latter policy would bring 
up the problem of instability of tie 
weightings in diferent situations due 
simply to differences in the type of fac- 
tor analytic, and rotation procedures 
used, the number and type of tests used, 
and the number of factors extracted. 
Table 1 shows the variables comps 
ing each factor, the relative weight a 
each (where applicable), and the direc 
tion of each variable, Index scores w 
not computed for Factors it. and: 4 
since they were neither easily ua 
pretable nor internally consistent. xy 
computing Index X (from Factor ea 
the Ship Destination test was not w 
cluded since it was already in aomi 
factor. The “unassigned books pol 
measure was included, however, in SP! i 
of its low loading because it did “un 
to go logically with hours spent on 1 
dependent work, Admittedly the — 
is not very internally consistent. T # 
Originality A and Originality B on 
were summed to form an Originality 
index which will be numbered Inde? 
XII. P 
One advantage of using index sar 
aS opposed to individual test scores he 
that the former procedure reduces p 
ratio of variables to subjects and To 
fore the number of significant predicto 
criterion correlations that could be r 
tained by chance. A second advantag g 
when the components of an index fe 
highly intercorrelated, is that in nt 
Scores will be more internally consist ga 
and stable over time than single p 
ures. Thirdly, index scores should r i 
tain less “specific” variance and ™ ts: 
“common” variance than single tes 


A nions are 
Finally, if the latter two conditions 


"s 
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t 
p 
ray 


Factor Rg 
* index Name Index components ares s 
I  Ideational Fluency Consequences + [AC-B-Part V] + Topics + 
[AC-A-Part I1]* 
Il Vocabulary Verbal Comprehension + Advanced Vocabu- 
lary + Wide Range Vocabulary 3 
II General Reasoning Special Problems + General Reasoning + 
Ship Destination + False Premises 4 
IV Self-Control versus Impul- Responsibility + Cautiousness — SRT + Per- 
siveness sonal Relations + Emotional Stability 5 
V School and City Size Class Size + City Size + % [Number of 
P 9 courses] 3 
VI Slowness Minnesota Clerical (time) — Letter Group- 
3 


ing — Marks 


a, If Research Opportunities 
oe Orientation towards People 
Bis Creative Energy 
X Independence versus Socio- 
economic Status 
Originality ” 
Total Number Variables 


XL 


Questions 1 + 5 + 2 3 
Ascendancy + Sociability 
Original Thinking + Vigor 
— [Ses] + [Hours on independent work] + 
[Number of un gned books read] 3 
Originality A + Originality B 2 
34 


but iee Categories test should have been in 
ifferen ee te mitted due to, a clerical error. Since al 
We i$ undoubtedly trivial. 

ot in original factor anal 


a ‘ 
in this i 


Satisfied, index scores should give more 
Consistent results with different samples, 
although in a given situation an indi- 
vidual test might predict better than an 
index score, 

if The reliabilities (internal consist- 
Ncies) of the indexes described in Table 

are given in Table 2." 

t The 11 factor indexes and the 2 cri- 
erion factor scores? were intercorrelated 
~ 


6 : 
by The internal consistencies were computed 
Means of the familiar S] earman-Brown 
formula p 


A 


1+(a—1)r 

Ww A 

t here a is the number of tests or forms of the 

fhe and r is the average intercorrelation among 
e tests, 
7 

co; Factor scores for the criterion factors were 

ing buted by weighting each variable accord- 
8 to its factor loading (see Locke, 1963). 


fact. was necessitated by the wide variation In 
Or loadings of the variables in each 


‘aa = 


ndex since it had the third highest loading on, Factor 
1l the factor lo; 


I, 
adings on this factor were very similar, the 


lysis; see text for explanation. 


TABLE 2 
INTERNAL CONSISTENCIES OF Factor INDEXES 
— Internal 
Factor index relation * gouste 
of compo- of index 
nent tests Score 
Ideational Fluency 40 .73 
Vocabulary 74 90 
General Reasoning A3 82 
Self-Control versus Im- 
pulsiveness 36 85 
School and City Size 58 81 
Slowness 37 64 
Research Opportunities 34 61 
Orientation toward 
People 54 70 
Creative Energy A3 -60 
Independence versus So- 
cioeconomic Status .19 Al 
Originality 30 46 


a Averaging was done after appropriate z trans- 
formations. 
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TABLE 3 


INTERCORRELATIONS OF INDEX SCORES 


Index Im M IV V VE VA VI Ix% x xm 
I Ideational Fluency 07 05 —.06 —.03 —.25 03 19 24 14 40 
II Vocabulary — AT~03 12-14 19 00 04 16 07 
III General Reasoning —-09 07—30 =04 10 29 —06 03 
IV Self-Control versus Im- 
pulsiveness = 10-04 04—13 18 —.24 —.09 


V School and City Size 
VI Slowness 
VII Research Opportunities 
VIII Orientation toward 
People * — 26-0 U 
IX Creative Energy G 0o B 
X Independence versus So- 
cioeconomic Status =, n 
XIII Originality 


—-08 15 06—06 .08 03 
— —.08 —.04 —.22 —.02 —.10 
— 06 12 —.19 06 


TABLE 4 
CORRELATIONS or INDEX SCORES AND CRITERION FACTORS 
(NV = 112) 
= = 


Criterion factor 


Factor index Classroom achievement 


A t 
Out-of-class achieveme? 
ge 


———_————— Total Boys Girls Total ~ Boys Girls 
Ideational Fluency i 

7 03 09 == z wu. 
Vocabulary ake oe A .05 .02 52 
General Reasoning 18 274 -08 «13 .01 2 
Self-Control versus Impulsiveness .22* 28% =a .06 01 7 a9# 
School and City Size re ra —.09 00 "Aga 

J =æ vë 2 

Slowness 7 -06 16 Ge 32 30 08 
Research Opportunities 18 21 ` -06 .02 38% 
Orientation Toward People a oe 09 i? = oS 
Creative Energy , 14 38t en .02 04 32 
Independence versus Socio- 3 250e 23 

economic Status —.21* gt 

Deseret —.14  _ 39%% 4 
Originality 02 i Z 3 zn A 38°" 
z 50b Joe dés ss aye 66° 

44% 6844 41* Sorte 34% 59 


at the .05 level. ` 
» Based on oi actor indexes. jfi 
© Based on indexes having significant correlation: 5 y rouP 
in ayestion, including school and city size for gir far Re, 0 Sor better) with criterion in question for & 
05. $ 


f-class achievement factor. 
wpe ai 
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for: the total group, all boys, and all 
girls. Multiple Rs were computed for: 
all 11 index scores against both criterion 
Scores for the total group, all index 
Spores which correlated significantly with 
imp criterion for the boys, and all in- 
ee which correlated significantly 
ith each criterion for the girls, All 
ee Rs were corrected for bias us- 
ri uilford’s (1956, p. 399) correction 
rmula, 

Te 3 shows the intercorrelations of 
The TE ex scores for the total group. 
sa validity coefficients” for the total 
Rs ‘a boys, and girls, and the multiple 
escribed above are shown in Table 


dite total group the variables 
achiever nily related to classroom 
trol, a orp were vocabulary, self-con- 
a oe socioeconomic status. It can 
cotta from an examination of the 
group ions by sex that the total 
č ee were due mainly to 
cantly a The only measures signifi- 
or the felted to classroom achievement 
and oh ag were lack of creative energy 
Socioeconomic status. 
Oy ieee energy was positively re- 
oys i classroom achievement for the 
relation z opposite direction from the 
o wos p obtained with the girls. No 
e giv explanation of this finding can 
will “tg but a possible interpretation 
6 oae ge In the first place, 
cim ginal thinking measure, which is 
ex Seng of the creative energy 10- 
if be more aptly called “intel- 
With aty since most of the items deal 
Curiosity and interest in knowledge 
Critical or philosophical thinking 
ossibl than originality per Se. It is 
intel, e that males who are “vigorous 
. tellectuals” are encouraged to achieve 
ot classroom by existing male social 
ment» MPhasizing scholastic “achieve- 
Ous in whereas females who are vigor- 
ntellectuals are actively discouraged 


from intellectual pursuits by existing 
female social norms emphasizing “popu- 
larity.” The energy of the female in- 
tellectuals may be channeled off into 
other (extracurricular) activities thus 
detracting from their required school 
work. The above explanation is, of 
course, highly speculative and cannot 
actually be tested with the data from 
this study. 

The probable reason why the girls 
were less predictable on this factor than 
the boys was that there was severe re- 
striction of range in the girls’ groups 
on classroom achievement as compared 
to the boys’ group. The variances of 
the two groups on this factor are signifi- 
cantly different, (F = 1.85, $ < .05), 
although the means of the two groups 
are nearly identical. 

There is somewhat more similarity 
between the boys and girls on the out- 
of-class achievement factor. For both 
sexes and the total group originality was 
significantly related to this criterion. 
For the total group and the boys, school 
and city size was significantly related 
to out-of-class achievement, and the 
correlation for the girls’ group just 
misses reaching significance at the 05 
level, In addition, for the girls’ group, 
vocabulary, impulsiveness, research op- 
portunities, and independence were sig- 
nificantly related to out-of-class achieve- 
ment, The most unexpected result for 
the girls was the correlation of vocabu- 
lary with this criterion factor. There is 
no obvious explanation for this finding 
(plotting of the relationships yielded no 
curvilinear trends), though it should be 
noted that the correlations of vocabulary 
with the two criterion factors were not 
significantly different for the women. 
This was decidedly not the case for the 
men, where the correlation of vocabulary 
with classroom achievement was signifi- 
cantly higher (p < -05) than the corre- 
lation with out-of-class achievement. It 
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might also be noted that the Meee 
correlation of vocabulary with out-o - 
class achievement for the girls is only 
.24 while the partial correlation with 
classroom achievement is .23. Thus 
when all other factor indexes are con- 
trolled, there is no significant relation- 
ship between vocabulary and either 
criterion factor for the girls. 

The greater predictability of the girls 
than the boys on the out-of-class 
achievement factor cannot be explained 
on the basis of differences in the means 
or variances of the two groups on the 
criterion factors since the groups were 
nearly identical in these respects. 

The significant relationship between 
research opportunities and out- 
achievement for the girls has a possible 
explanation. It will be recalled that 
two of the three questions involved in 
this index concerned teachers’ willing- 


ness to help the student with independ- 
ent research, It is c 


ommonly accepted 
that personal relationships are more im- 


than for men and 
teachers may have 
in motivating girls 
than for boys, 

the obtained re- 
ool and city size 
vement was due 
rger high schools 
facilities (librar- 
better teachers, 
irs, and a gener- 


of-class 


It is probable that 
lationship between sch 
and out-of-class achie 
to the fact that the la 
and cities have better 
ies, laboratories, ete.), 
more frequent science fa 
ally more “intellectual” orientation than 
smaller high schools and towns, 

All the corrected multiple Rs jn Table 
4 are significant at the 05 level or 
better. It should be noted, however, 
that these “predictors” are not all “jn- 
dependent variables.” Aq] the out-of- 
class achievement behavior took place 
before any of the students were tested 
and in addition the number of hours 
spent on independent work and the 
number of unassigned books read were 
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behaviors that were undoubtedly accur 
ring along with the out-of-class ee 
ment behavior. Similarly, part of Le 
classroom achievement behavior oa 
school grades and summary ap 
took place before the students we i 
tested and part of it (Cornell grades A 
summary ratings) took place after ens 
ing. The multiple Rs merely indicate xa 
amount of criterion variance “accoun > 
for” in variables not included in the ct 
terion measures. All the criterion of 
ures and all predictor indexes a 
however be used to try fo predict eS 
(college and postcollege) achievements 
of these subjects, 


Discussion à 

Since the two criterion factors n 

in this study were independent, it bie 

to be expected that different ae 

would be related to each. Insofar as ilar 
classroom achievement factor is simi 


“grade , 
to what is traditionally called “gt 


s 
achievement” and the out-of cin 
achievement factor is similar to W as 
other researchers have referred ae 
“creativity,” this study can be con ee 
to other studies which have explore 
Correlates of these factors. f Na- 

Holland (1961), in a study © J of 
tional Merit Scholars, found att 
independence, self-control, and atl 
Scholastic aptitude to be significa 
related to science grades, Smith Ceen 
found significant correlations bet the 
grades and two measures HOM gt 
Gordon Personal Profile which index 
prised part of the self-control also 
used in this study. Tallent (1956) pe 
found a measure of self-control jes 
related to grades. Numerous studi een 
course, have found relationships be 
mathematical and verbal IQ mea s 
and grade achievement. The finding jth 
this study would seem to ag yer 
Previous findings in that math reno 
bal TQ (vocabulary and general ™ 


sures 


CORRELATES OF Crass AND OUT-OF-CLASS ACHIEVEMENT 


ae and self-control were significantly 
Er to classroom achievement, at 
for ii or males. The relationship found 
hed tomy between lack of independ- 
a igh socioeconomic status) and 
H oom achievement also parallels 
olland s finding above. 

in os not surprising that achievement 
da e structured environment of the 
ssroom should be related to intelli- 
o test scores since the types of prob- 
et ee in the two situations 
nated similar. Similarly the relation 
avd T self-centrol or responsibility 
Prisin assroom achievement is not sur- 
etat since the latter often requires a 
ards — r of conformity to stand- 
faithtul e following of directions, and 
teacher compliance to norms set by 
unim s, The point is not to „consider 
RE this form of achievement 
ië Rg it requires “conformity,” 
classroo er to appreciate the fact that 
“vee: achievement is only one kind 
Sea e requiring a particular 
e ina of traits and abilities that may 
f Ppropriate or irrelevant to other 


o 

olen achievement. 
deriba (1961), in the study de- 
ed above, found lack of responsi- 


bility; 
stat? independence, lack of desire for 
signifie originality, and initiative to be 
Ctiterign Y related to a creativity 
RE idan much like the out-of-class 
Aniela oe factor used here. Piers, 
an ori » and Quackenbush (1960) found 
Sk Saige measure to be related to 
Darallı S ratings, These findings also 
Îvenes the ones in this study. Impul- 
Donsiht (or lack of self-control and re- 
Socigg ility), independence (or low 
Greate omic status) and originality 
for ated with out-of-class achievement 
ä a females and originality for the 
Measy It should also be noted that two 
to res of initiative formed part of the 
Stug -class achievement factor in this 
y (Locke, 1963). 
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Again it is not surprising that achieve- 
ment outside of the structured environ- 
ment of the classroom should be more 
highly related to personality measures 
indicative of independence and initiative 
and intellectual factors such as origi- 
nality than to traditional intelligence 
measures and self-control. Outside the 
classroom a student is told neither what 
to do nor how to do it; the discovery 
of both means and ends must usually 
be made independently or with the help 
of a teacher contacted at the student’s 
own initiative. Again it should not be 
assumed that there is anything inher- 
ently superior in out-of-class achieve- 
ment or creative achievement as Holland 
(1961) calls it. Little is known about 
the relationship between the two cri- 
terion factors used here and later life 
success, however defined. Similarly, 
little is known about the kinds of meas- 
ures most highly predictive of various 
kinds of later life success. It may be 
that schools will find it more profitable 
in the long run to nurture abilities other 
than intelligence and utilize criteria of 
success other than grades. 

It is perhaps fortunate that the two 
measures of achievement used in this 
study (and the similar indexes used by 
Holland) appear to be independent 
rather than negatively related. This 
would suggest that there is nothing to 
prevent schools and teachers from em- 
phasizing both criteria rather than em- 
phasizing one at the expense of the 


other. 
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EFFECT OF INTRALIST 


ITEM SIMILARITY ON 


PAIRED-ASSOCIATE LEARNING BY LEARNERS 
OF HIGH AND LOW VERBAL ABILITY? 


LOWELL SCHOER 
State University of Iowa 


The present study w; 
ceptibility 


account for at least part of the differ 
and low verbal ability learners. The le 
of paired adjectives: List I with low 
List II with high intralist response competition. 
action between ability level and list w: 
that the low verbal ability learner is more a 


as designed to determine whether differential sus- 
to the inhibition introduced by competing responses may 


ence in the performance of high 
arning material consisted of 2 lists 
intralist response competition and 
A significant inter- 
as found. This finding suggests 
dversely affected than the 


high verbal ability learner by response competition. 
da 


beget influence of individual differences 
ias ken ability on learning performance 
aitain ie widely investigated, but few 
tioa p have been made to determine 
this i perons which might account for 
ae pare The present study was 
One to investigate one such factor. 
TE Rr that influences paired- 
Sion “4 learning is the similarity 
1951 Sa e stimulus words (Underwood, 
esna 53) and, although perhaps to a 
respons egree, the similarity among the 
957) Ee (Feldman & Underwood, 
ir ince discrimination among the 
Wards S words and among the response 
assoc} sib a necessary part of paired- 
Riera ne (Gibson, 1940), any 
fhe m, difficulty as a function of 
amon sed similarity among stimuli and 
le § response words is quite probably 
cult pa partially due to the more diff- 
Goce iscriminations these similar words 
— the subject to make. 
- a result of this increased difficulty 
Cage minati there is likely to be in- 
or IET response competition among the 
S in the list due to stimulus and 


1 

The author wishes to thank W. Lucht and 
ata icholsen for their aid in gathering the 
his h tae this experiment and J. B. Stroud for 
Script. Pful suggestions in preparing the manu- 
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response generalization. The question 
investigated in the present study was 
whether subjects of high and low verbal 
ability are affected differently by such 
an increase in response competition. If 
such an effect were found, it would 
suggest that perhaps one of the factors 
which accounts for the difference in the 
learning performance of high and low 
verbal ability subjects is differential sus- 
ceptibility to the inhibition introduced 
by response competition. 

Investigating this possibility by com- 
paring the performance of subjects of 
high and low verbal ability on lists with 
varying degrees of similarity among 
stimulus and response words involves 
the assumption that an increase in such 
similarity increases response competi- 
tion. A necessary part of the present 
study then was to determine the validity 
of this assumption. This was done in 
a preliminary analysis of the data, using 
number of intralist intrusions as a meas- 
ure of response competition. 


PROCEDURE 


The subjects for the experiment came from 
the undergraduate course in educational psy- 
chology at the State University of Iowa. Early 
in the semester all the students in one section 
of the course were given a 75-item vocabulary 
test. Those who scored in the upper half of the 
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class on this test constituted the pool from 
which the high ability experimental subjects 
were drawn, and those who scored in the lower 
half constituted the pool from which the low 
ability experimental subjects were drawn. 
The learning material consisted of two lists 
of paired adjectives taken from the Haagen 
(1949) list. List I was composed of eight 
pairs of adjectives of high familiarity with 
low association between the stimulus and re- 
sponse members of each pair as well as among 
the eight stimulus members and eight response 
members of the list. List II consisted of eight 
pairs of adjectives matched on the dimension 
of familiarity with the words in List I. Also 
like the words in List I there was low associa- 
tion between the stimulus and response mem- 
bers of each pair. Unlike List I, however, all 
eight of the stimulus words were synonymous 
and all eight of the response words were syn- 
onymous. It was anticipated th 


at the syn- 
onymity among the stimulus an 


d among the 
provide con- 


stimulus and respon: 


was asked to anticipate the response before it 


interval be- 
ven 3 trials 
I of adjectives 
experimental list, Each 


learning trials on the 
earned only one such 


tween trials. All subjects were gi 
on a practice list of three Pairs 
prior to learning the 
subject was given 12 
experimental list and } 
list. 


RESULTS 


Table 1 shows a decided į 
intrusions as a function of 
similarity among the stim 
among the response words, The primary 
interest in Table 1 is in the main effect 
of list, and analysis of variance showed 
this effect to be significant at wel] be- 
yond the .01 level. This significant main 
effect lends considerable support to the 
assumption that an increase in stimulus 


ncrease in 
Increased 
ulus and 


Lowett SCHOER 


TABLE 1 


ç Y 
Numer or Intrusions on Lists I np II B 


Ability level 


Number of a Low 
intrusions - bgt (n = 26) | 
List I 14.2 B3 
List II a 


and in response similarity increases 
response competition. “ 

As can be seen by looking at p 
mean raw scores given in the parentie 
in Table 2, List II was considera A 
more difficult than List I. In order he 
put the scores of Lists I and II on hs 
same scale, the raw scores were ia 
formed to standard scores and r 
analysis was based on these standa e 
scores, This transformation was ™4 ts 
by combining scores for all the ap 
on List I and determining Z a 
equivalents for each raw score value. the 
order to remove the decimals and ch 
negative signs from these z scores, 0. 
was multiplied by 10 and added to ith 

he same procedure was followed W 
List TI. a- 

These standard scores were then = 5 
lyzed using a Treatments X DA: 
statistical design (Lindquist, 19 aifi- 
The main effect for ability was SiS% | 
cant at greater than the .01 level- ti 
cause of the nature of the transforme js 
employed the main effect for ant: 
Would not be expected to be significa” < 


eS 
The primary interest for the putP nits 
of the present study was in the P pis 
action between ability and list; tha? 
interaction is significant at greater, tet 
the .05 level, The source of this 1 st 
action is evident from Table 2. otes 
of the simple effects in Table 2 ee 
that the difference between the hig on 
low ability students is not significan 


on 
y 


INTRALIST INTERFER 


TABLE 2 


Mean Stanparp Scores or Hic anp Low 
Asinity Supjects on Lists I axo H 


a (N = 52) 
i Ability | level 
List High > Low 
7 (n= 26) (n= 26) 
l = 
ie standard scores 51.5 49.2 
Mean total correct 
responses 61.0 sas 
nan stundaré scores 55.3 448 
Mean total correct 
responses 38 Ale 


List © (¢ = g4, p > 10) but is highly 


significar? f 
o eni on List IT (£= 3.47, p < 


DISCUSSION 


of Te present study suggests that one 
ls factors that may account for at 
ere of the difference in the per- 
is ia of high and low ability learners 
ibiti erential susceptibility to the in- 
geome introduced by competing re- 
that the This indicates the possibility 
Perfo tigh and low ability students might 
if : m equally well on a learning task 
in su anena to be learned is presented 
bilit, 5 Pi way as to minimize the poss!- 
ing 7 that strong incorrect and compet- 
Tesponses are aroused in the learner. 
hers may, in fact, be the reason that 
well and low ability learners do equally 
Sram es material is “pro- 
Cose. ,? since in linear programing @ 
ing cious effort is made to present learn- 
the Material in such a way as to make 
ie Correct response relatively obvious, 
e Minimize the possibility that plaust- 
incorrect responses will be aroused 
e learner, To the extent that this 
fig oe response competition it reduces 
at Of the factors that seems to cause 
east part of the difference in the 


in 
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performance of high and low ability 
learners and should, therefore, make 
their learning performance more similar. 

This possibility finds some support in 
the results of a recent study by Shay 
(1961). Varying step size, Shay found 
a significant interaction between ability 
and step size, with the above average 
learners showing significantly less de- 
crease in probability of correct response 
as step size is increased than did the 
below average learner. The added re- 
sponse competition introduced as the 
steps in the program becomes larger 
could account for at least part of this 
effect. 

The suggestion that the less proba- 
bility there is of a stimulus arousing 
two or more competing responses in the 
learner the less probability there is that 
there will be a difference in the per- 
formance learners of high and low verbal 
ability may also indicate the reason why 
such a low relationship is typically found 
between intelligence and performance in 
paired-associate learning. The learning 
material employed in such experiments 
has typically been of the type used in 
List I, i.e., intralist response competition 
is at a minimum. To the degree that this 
type of material reduces response com- 
petition, which at least partially ac- 
counts for performance differences be- 
tween high and low ability learners, it 
would tend to reduce the differences 
found between the performance of high 
and low ability learners. 
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COMPARISON OF SEVERAL RESPONSE MODES IN 
A REVIEW PROGRAM 


JOANNA P. WILLIAMS 


A program was administered as ri 
which varied in response mode. 


response group and the multiple-choice group 
phasis group, which read through the 


ds underlined, and the reading group, 
When the test item required that S 


groups scored higher than the em] 
completed program with key wor 
which read it without underlines. 


respond with novel, “technical” terminology, 
group scored higher than the multiple-choice gr 


efficiency the groups were ordered as 


reading, multiple-choice, 
with aptitude. 


constructed- 


University of Pennsylvania 


eview to college students in 4 versions, 
The performance of the constructed- 


did not differ, and these 


the constructed-response 
oup. In terms of learning 
follows: emphasis (most efficient), 
response. Performance also varied 


— 


sae of the most generally accepted 
the a in programed learning is that 
he student must actively participate in 
ete ee This recommendation 
ple a the general psychological princi- 
it ca at a response must be made before 
Viha be reinforced, and it is consistent 
hl findings of the older (prepro- 
tior ing) literature on active participa- 
D (eg., Gates, 1917). 
iae the reasonable expectation 
le E: important and general a princi- 
Dia rem be easily demonstrated in the 
bitte mo instruction context, the em- 
Holla Pe is surprisingly slim. 
idie (1960) found that students who 
half an answer to each item made only 
test as many errors on a subsequent 
alreads did students who read through 
and ve completed items. Krumboltz 
ject, Veisman (1962) found that sub- 
i hh who wrote out responses scored 
a er than those who made covert re- 
Bona and those who simply read the 
on ram, but these differences appeared 
on Y on a delayed criterion test and not 
of an immediate one. Yet the majority 
aa (e.g, Evans, Glaser, & 
dve te 1960; Keislar & McNeil, 1962) 
ot supported this principle. 
6 cg it is still an open question as 
at constitutes active participation. 
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Skinner (1958) suggests that the stu- 
dent be required to construct his own 


responses and write them in on each 
on the other 


frame. Pressey (1950), 
hand, suggests that simply to select a 
response from a set of alternatives would 
satisfy the requirements of active par- 
ticipation. Comparisons of the effective- 
ness of these two modes of presentation 
have usually failed to show differences 
(e.g., Coulson & Silberman, 1960; 
Hough, 1962). Fry (1960), however, 
using a Spanish vocabulary program 
found that a constructed-response mode 
led to higher achievement than did a 
multiple-choice mode on a recall test, 
though not on a test of recognition. 
There is no case where a typical con- 
tinuous discourse program showed such 
an effect. 

These two modes are not the only 
possibilities for ensuring active partici- 
pation. Perhaps a subject need not con- 
struct each response nor even select it 
from an array, but simply focus his 
attention on it, In other words, the key 
points might be written into the pro- 
gram, but emphasized (by underlining, 
for example) in such a way that the 
subject’s attention was ensured, This 
emphasis might lead to minimal but 
sufficient active participation. 
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Each of the presentation modes de- 
scribed might be considered as differing 
in the number of aspects of active par- 
ticipation which they include: the con- 
structed-response mode contains choice 
and attention along with construction of 
the responses, the multiple-choice mode 
contains attention and choice, and the 
emphasis group includes only attention. 
From a theoretical standpoint it seems 
important to investigate the effective- 
ness of active participation and the par- 
ticular aspects of it which are critical, 
and there are practical considerations to 

the problem as well. The cost of a 
program, the time it requires, the prob- 
lems of administration, and the com- 
plexities of the teaching machine, if one 
is used, would all be cut down if a rela- 


tively simple mode of presentation were 
acceptable, 


mentary Psycholog 
constructed-respon, 
choice version, a 


In addition to an assessment of ef- 
fectiveness, as reflected in Mastery of 
the material, the efficiency of the sey- 
eral versions was examined, While a 
particular presentation mode may result 
in a higher level of mastery, it may 
cost a great deal in extra time, and in 
certain situations might be rejected on 
the grounds of inefficiency, A character- 
istic finding (e.g., Goldbeck & Campbell, 
1962) has been that training is more 
efficient when constructed responses are 
not required. In the present study, 


time scores were recorded in order to 
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examine the relative efficiency of the 
particular presentation modes used. 
There is a possibility that differences 
between the constructed-response mode 
and the multiple-choice mode are oftel- 
obscured by the fact that the con- 


: ior onl 
structed-response mode is superior only _ 


for certain kinds of items. For example, 
if the reponsE required on the test 
a novel term which has been ine 
by the program, or any word which ee 
not a highly overlearned response a 
se, then presumably the overt pract! 
from writing it out shoulil aid sal 
On the other hand, where the words r > 
quired are common terms in the eed 
ject’s vocabulary, constructing ie 
within the context of the program A 
not be of much value, In other oe 
in the first case, when there is a n be 
term, there is response learning sen 
accomplished as well as the aesoch (the 
of the response and the stimulus 
item), whereas in the second peo 
response learning has been compie i 
outside the context of the program sai 
need not be provided for. The ee the 
experiment will test the hypothesis ted- 
the difference between the construc ice 
response mode and the multiple ree 
mode depends on the type of a ee 
In this experiment active par 0 
tion was investigated in the rn 
review materials. To answer the EA 
tion of whether a program ont a 
introductory material could be ane 5 
review material, a number of su J ts 
were administered the criterion pro- 
Without having gone through en 
gram in any form. While prog" jsing 
instruction appears to be a prom. 
solution to the problem of aque ut 
Subjects on previous learning aoe of 
taking up class time, an examinati? 
its value as review is desirable no 
it is adopted wholesale by the eri- 
While the major focus of the eP" is 
ment was on active participation, * 


ted 


RESPONSE MODES IN PROGRAMED LEARNING 


possible to analyze the data with re- 
gard to another issue as well. The lit- 
oe is unclear as to how the effec- 
one of programed instruction is 
ser by aptitude. While typically 
in itude is correlated with achievement 
ie ae instruction, Ferster 
a a a (1958) and Porter (1959) 
mate no such relationship between apti- 
S and achievement when programed 
ibe er were used. In Porter’s study, 
e bjects who received more typical 
EA neton did show a correlation be- 
noi ag and achievement. Lam- 
ae “ iller, and Wiley (1962), on the 
i be over a wide IQ range, found 
eni 1 programed materials achieve- 
ii Scopes were higher for high IQ 
aoe The present study will also 
pease the effectiveness of programed 
ee ion as a function of aptitude, as 
Tent by the Scholastic Aptitude 
erbal (SAT-V). 


METHOD 


Subjects 


agg Satins were 128 educational psychol- 
Semester ents, all of whom had completed a 
35 additi of gencral psychology. A total of 
imps Go subjects was dropped from the 
complet or the following reasons: failure to 
sekedi oe training and testing during, the 
tions ed class period, failure to follow direc- 
scout, 2d unavailability of aptitude test 
domly) Eight subjects were dropped (ran- 
a i order to equate N in each group. 
56 aut jects were run in two replications: 
tion of 75 were included in the first replica- 
» and 72 out of 96 in the second. 


Materials 


Py Ass (totaling 192 frames) of the Hol- 
avio. inner program, The Analysis of Be- 
ac 2 were reproduced in booklet form. 
Ga ee appeared on a separate pages with 
Correct response (where required) printed 
on the following page. Each set of 
S was stapled into a separate booklet. 
Program was reproduced in four forms: 


1 
< Constructed response (CR): Standard 


Tame. 
The 


format, in which the subject was required to 
write out answers on every frame. The sub- 
ject found the correct response to each frame 
on the following page. Turning the page 
again exposed the next frame. 

2. Multiple choice (MC): Under each item, 
presented in the standard way, two responses 
were printed. The subject was instructed to 
underline his choice, and he found the correct 
response on the following page. 

3. Emphasis (E): Each item appeared as 
a complete statement; the words which in the 
standard program are left to the subject to 
fill in were underlined. No answer pages were 
provided. 

4, Reading (R): Each item appeared as a 
complete statement, no part of which was 
underlined. No answer pages were provided. 


An objective test was made up of 20 items 
taken from Test Unit 17 of the program. A 
total of 29 constructed responses was required 
of the subject. In addition, an “essay” test was 
given. The subjects were asked to write an- 
swers to the following two questions: 


1. One-year-old Bobby whines a great deal, 
especially when he is hungry. What are two 
ways in which you might go about eliminating 
his whining? Describe them fully, using tech- 
nical terms whenever possible. 

2. Why is money so effective in producing 
desirable behavior? Analyze its function, using 
Skinnerian principles and terminology. 


Procedure 


The subjects were randomly assigned to one 
of the four training conditions. On the first 
day of training, Sets 7, 8, and 9 were com- 
pleted, and the following day, Sets 10 and 11 
were completed. Each subject recorded the 
amount of time he had taken to work through 
the program. The subjects were excused from 
class when they had completed the assignment. 

The criterion tests were administered 1 week 
after the start of training. In both replications 
the essay test was given prior to the objective 
test. Twenty minutes were allowed for each 
test, and all subjects finished within the time 
limits. 

Before the experimental training the subjects 
were told that this was an experiment in pro- 
gramed instruction and that the class would 
discuss the data later in the semester. It was 
pointed out that their test scores would not 
count as part of their course grade, but that 
later lectures would assume mastery of the ma- 
terial presented in the program. 
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roup (N = 32) of similar subjects 
ee aei gencral psychology ni 
given the criterion tests without having zo 
through the program in any form. Te ni 
conditions were kept as similar as possi le to 
those of the groups in the main design. 


RESULTS 


Because there were no differences be- 
tween the two replications in the mean 
number of correct responses on the ob- 
jective test as a function of response 
mode (F = 3.73, df = 1/120) nor in 
aptitude (F = 2.92, df = 1/120), the 
two replications were combined for 
analysis. 

Means and standard deviations of the 
scores are presented in Table 1, The 
standard deviations increase as the 
amount of participation decreases, and 
that of Group CR is significantly smaller 
than that of any of the other three 
groups (e.g., CR versus MC: F= 2:51, 
df = 31/31, b < .02; there were no 
differences among groups MC, E, and 
R). To offset the heterogeneity of 
variance, a significance level of .025 was 
set on subsequent Statistical tests, 

Table 2 indicates th 
scores within various 
range. It is evident t 
variability of Groups 
due to the absence of lo 
groups, 

The subjects in eac 
ditions were dichotom 


W scores in these 


h of the four con- 
ized at the median 


on the basis of aptitude score (SAT-V),, 
and analysis of variance showed that 
there were no differences jn aptitude 
TABLE 1 
NUMBER CORRECT on THE CRITERION Test 
E 
Group M SD 
-= = 
CR 23.5 24 
MC 23.0 3.3 
E 20.7 3.9 
R 20.6 43 
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TABLE 2 


SG IN DIFFERENT 
FREQUENCY oF Scores FALLING IN DIFF 
PORTIONS OF THE RANGE 


Response cage aie 
mode 10-15 16-21 
CR 0 6 vi 
M 1 6 i5 
E 3 14 16 
R 5 11 ers 


zjgure 
among the four response modes. bat 
1 presents the mean scere on t onse 
jective test as a function of ane 
mode and aptitude level. Both ode: 
effects were significant (response nant 
F = 6.48, df = 3/120, p < .001; 005): 
tnde: P = 8.26, af = 0/1208 < 
and the interaction was not Sa that 
Specific comparisons maient a 
Groups CR and MC were not di 1 sig- 
from each other, but they arren ai 
nificantly higher than did Groups 001): 
R, (F = 38.20, df = 1/120, p < fier- 
which were also not significantly ¢ 
ent from each other. ‘on did not 
The mean of the group which ¢ was 
go through the program in any forn 5.0. 
8.8; the standard deviation was and 
The difference between this StOUP oti 
the other four is so large that a oa 
cal test would be only a formality- 


MEAN NUMBER CORRECT 
ee 
a P 
d 
li 
j 
1 
I 
1 
1 
I 
s 


high aptitud? 


RESPONSE MODE gon of 
nct 
1G. 1. Test performance as TA 
response mode and aptitu 


F. 


RESPONSE MODES IN ProcraMeD LEARNING 257 


fi The essay tests were graded on an 
ole scale (with 1 representing the 
the tests). Since the reliability of the 
Bid oe who scored these tests (ad- 
Cras g —— te students in psychology) 
has Se y .55, no analysis of these data 
been made. i 
Pao 2 indicates the mean time 
functi to complete the training as a 
ide ma presentation mode and apti- 
nificant ode of presentation was a sig- 
p i, effect (F = 65.15, df = 3/120, 
Was pore, Hale each of the four groups 
others ay different from the 
significa “ty aptitude subjects took 
Subject ntly less time than low aptitude 
01). art (F = 8.06, df = 1/120, $< 
present tite was no interaction between 
Corre ion mode and aptitude. 
aken pce among aptitude, time 
score Bie me the training, and 
in Tabh the objective test are presented 
tions a 3. In each of the four condi- 
etweer here was a positive correlation 
ere rs aptitude and test score. Since 
corélatio, no differences among these 
correlation i an overall estimate of the 
Nificant on was made; it was .38, Sig- 
between w the .01 level. The correlation 
trol gro aptitude and score in the con- 
receive ep (those subjects who did not 
ibsendy o. training) was .27, not sig- 
8roups 1 different from the other 
etween n all conditions the correlation 
aptitude and training time was 


TIME (in min.) 


a ail 


CR McC 
RESPONSE MODE 
a function of 


Fig 
> 2. Training time as 
ptitude. 


response mode and a 


TABLE 3 


CORRELATIONS AMONG APTITUDE, TRAINING 
TIME, AND SCORE ON CRITERION Test 


Group Aptitude Time Aptitude 
andscore andscore and time 
CR PY —.17 —.23 
MC 23 31 —.21 
E 34* —.14 —.20 
R 37t «14 —.45* 
*p<.05. 


negative, andin Group R this correla- 
tion reached significance. There was no 
relation between training time and test 
score. Each of these correlations was 
also computed with the third variable 
partialed out, and this procedure did 
not change the general pattern of cor- 
relations nor the conclusions based upon 
them. 

An efficiency score was calculated for 
each subject by dividing his performance 
score by his training time. Mean effi- 
ciency score as a function of presenta- 
tion mode and aptitude is presented in 
Figure 3. Analysis of variance showed 
that both variables were significant 
(presentation mode: F = 19.61, df = 
3/120, p < .001; aptitude: F = 15.01, 
df = 1/120, # < 001), and there was 
no interaction. Specific comparisons 
showed that each presentation mode was 
significantly different from the others. 


Panne aptitude 


Pe 


© 
A Sa so 


EFFICIENCY (score/training time) 


R Mi E R 


RESPONSE MODE 


Fic. 3. Efficiency as a function of 


response mode and aptitude. 
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These data indicate that Group E was 
the most efficient mode, especially for 
itude subjects. 
Eoo the Bonofe that the effec- 
tiveness of the different response modes 
depends on the type of test item, eight 
items which required that the subject 
respond with a technical term intro- 
duced by the program were selected 
from the test. Because the distribution 
of scores was markedly skewed, a square 
root transformation was made. Figure 
4 presents the mean number correct for 
these items as a function of response 
mode. An analysis of variance on the 
transformed scores indicated that there 
were significant differences among the 
groups (F = 2.87, dj = 3/124, p <.05) 
The hypothesis under consideration pre- 
dicts that Group CR will be significantly 
different from the other three groups, 
and this specific comparison was made. 
Indeed, this comparison shows signifi- 
cant differences (F= 7.73, df = 


1/124, 
p< 01), Moreover, there are no dif- 
ferences among the other three groups 
(F <1), 


Discusston 


25 


Seg 


aan 


MEAN CORRECT Ctransformed scores) 
N ~ 


CR 
RESPONSE MODE 


Fic. 4. Score on technical items as a 
function of response mode. 
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mode proved as effective as the ai 
structed-response mode in terms of tot 3 
test score, but these modes were spr 
to the emphasis mode and the — 
reading mode. The fact that pee 
reached significance in both the a 
study and that of Holland (1960) ma} 


F ri he* 
be due to the particular merits of t 


Holland-Skinner program, which is? 
used in both studies. On the other et 
it may be due to the adequacy 0 hich 
sample size in both experiments, W? 
was often lacking in other studies. ved 
While Groups CR and MC proie 
superior in terms of test score, F the 
ference between these groups an tical 
other two was very small. For Daa 
purposes, such small gains might ee ken 
worth the greater amount of time ta 
in those conditions, ëg of 
Though the performance scor is 
Groups E and R were compat time 
Group R took significantly a wa 
to complete training, and Group ode: 
the most efficient presentation mO% 
The relative inefficiency of Group sug 
due to the low aptitude subjects, i er- 
gesting that emphasis through, ome 
lining can control performance a nique 
cases, and suggesting that this tech ning 
be considered in developing lear 
materials, 
Exposure to the program in any 
led to scores greatly superior to ining 
of the group which received no tra effec” 
This difference demonstrates the evieW 
tiveness of the program as 4 gin? 
When given some time after ourse 
learning. Its effectiveness, of facto" 
may be due to any of several A at 
and the present results do not mea rov? 
other kinds of review might not p 
even more effective. 
eee 


form 
thos? 


ven thone, 
1It is interesting to note that ee we 
© program was designed as introdu admine 
terial, results from a questionnal p ue 
istered after the experiment adien espos he 
subjects (for whom this was the firs ‘avo! t 
to programed instruction) tended to $° 
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wt variance of the CR group 
is e lack of low scoring subjects in 
pa — R indicate that the program 
the esigned by Skinner does ensure that 
e 1a level of performance is 
A high. It has previously been 
ioo at achievement scores are more 
Wha penean for a group of subjects 
Stou ave used a program than for a 
o trained by some other method. 
ime there were many differences 
trol “4 the program group and the con- 
Se a in these studies, and it is im- 
ing ie ia identify the factors account- 
arm he differences. In the present 
varied ent only active participation is 
acto’ and it can be concluded that 
Stee He is at least one of the 
is s which controls the variance of 

~ Scores, 
seme ee that achievement scores 
than ao for high aptitude subjects 
ent ae aptitude subjects 1s consist- 
iley fa of Lambert, Miller, and 
A i ). Yet the question of the 
ness of ship of aptitude to the effective- 
answer pe eg instruction cannot be 
i he on the basis of these findings. 
betire there is a significant correlation 
instructi achievement after programed 
nena and aptitude (contrary to 
Ween s findings), the correlation be- 
group Performante and aptitude in the 
al as ich did not use the program at 
Š Ex not significantly different. Since 
Diter Co was review, and since no 
orma was given to assess level of per- 
ites ak prior to the experimental 
lle ee the present findings may be 
Kesini ely to differences which were 
ered t before the program was adminis- 
. At any rate, it is clear that 


Us, 

tha a this type of material in review rather 
of eae original learning. Moreover, jn terms 
Patter all attitude, the groups followed the 
Tvora of their performance scores; all were 
the able, but Groups CR and MC regarded 
Ea ha ae more favorably than did Groups 


and 
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differences in proficiency already present 
cannot be removed by administering a 
program of this type: after the review, 
there were still differences in perform- 
ance as a function of aptitude. 

Although a case has been made for 
the superiority of a constructed-response 
mode over a multiple-choice mode, there 
are very few empirical studies which 
support it. Tt is suggested here that one 
reason for the negative findings is that 
the effects are different for different 
kinds of items. Test items which re- 
quired the use of a novel term intro- 
duced by the program showed differ- 
ences between these two response modes. 
In fact, it is likely that the differences 
between the two modes were attenuated 
somewhat in the present study due to 
the fact that the program was review 
and thus the terminology already some- 
what familiar to the subjects. More- 
over, the only other study in which a 
constructed-response mode and a multi- 

le-choice mode were significantly differ- 
ent did not use a continuous-discourse 
program (Fry, 1960). Frames ina good 
continuous-discourse program follow 
each other logically and closely, and the 
portion of the frame to be completed by 
the subject—and the test items—do not 
necessarily require use of new termi- 
nology. Fry’s foreign vocabulary pro- 

ram and test, on the other hand, prob- 

ably included for the most part items 
which would fall into the category of 
novel or technical terms. 

These conclusions are based on tests 
administered relatively soon after com- 
pletion of the program, of course. One 
possibility which seems not to have been 
adequately investigated as yet is that 
though the differences are small in im- 
mediate retention, the active participa- 
tion groups might increase their lead 
over the others after further instruction 


of whatever type. 
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INTEREST PATTERNS OF PEACE CORPS 
VOLUNTEERS IN A TEACHING 
PROJECT* 


GEORGE M. GUTHRIE anp MARGARET S. McKENDRY 
Pennsylvania State University 


Analysis of attitude, interest, and adjustment data on 331 Peace Corps 
volunteers indicates a high incidence of social service motives and esthetic 
interests. Adjustment patterns on MMPI suggest a lower-than-average 
incidence of anxiety symptoms and infrequent atypical profiles. Motives 
for joining include educational, altruistic, and political, Prediction of 
performance is hazardous due to lack of continuity with previous experi- 
ence. Many volunteers present a pattern of interests for which only a 
limited“ number of satisfying career opportunities exist in our society, 


since many social service occupations are accorded relatively 


lower status. 


a ee is concerned with some 
attitudes 2 personality, interests, and 
rainees S, a group of Peace Corps 
EE a aoe the Peace Corps had just 
ion ene ished no adequate informa- 
available hen job requirements was 
new a ince it was a new job, with 
Surprising e, under new rules, it is not 

ae fern _ preliminary results 
dations b ) indicate insignificant cor- 
American e predictions of a final 
Detformano. ection board and ratings of 
tediction op the job. Traditionally, 
Samples on „performance is based on 
Tevious tained in various ways of 
Sible in Sram This was not pos- 
ect, his instance because the sub- 
an aS not previously performed in 
significa culture and had not had any 
"dle thee Previous experience in the 
reasons Y were to undertake. For these 
Wentig,? it would seem important to 
Use i Population characteristics for 

Potential predictor variables. 


§ METHOD 


ub j ects 


ig te sub; 
Suey row eels were 331 men and women of 
i, r of volunteers who had been se- 
tiacting Bene was presented at the Annual 
ig¢ion, S the American Psychological Asso- 

2, ° St Louis, Missouri, September 5, 
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lected for training for service in the Philippines 
as aides to teachers in rural elementary schools, 
helping with English as a second language and 
with beginning science instruction. All but 10 
of the volunteers in this sample had com- 
pleted college. Three-quarters were liberal arts 
graduates and the balance had been trained as 
teachers. The majority had completed their 
education less than a year before joining the 
Peace Corps. There was one married couple 
in their fifties and 7 volunteers were between 
30 and 40 years of age. The balance were in 
their twenties with a marked concentration in 
the age range of 21-24. 


Procedure 


Tests were administered early in training 
with the assurance that results were for re- 
search purposes and would not be a determin- 
ing factor in selection. The volunteers were 
asked to take the MMPI, the Strong Voca- 
tional Interest Blank (SVIB), the Study of 
Values, and a 100-item Q sort of purposes 
for joining the Peace Corps. This last device 
was developed by asking groups of college 
students, not in the Peace Corps, to write down 
reasons for which they might join. They were 
classified by inspection, and a set of 100 state- 
ments was developed which was presented as 
reasons that persons had given for joining the 
Peace Corps. An attempt was made to have 
reasonably plausible and acceptable statements 
which would elicit individual differences be- 
tween volunteers. Examples of statements are 
“J would like very much to help others,” “I 
want the perspective which this experience 
would give,” and “I believe I have some tal- 
ents and skills that would be of great value 
to others.” The subject was instructed to sort 
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the statements into a forced normal Havis 
tion according to the degree to which eac! 
statement expressed his purpose in joining the 
Peace Corps. 


RESULTS 
MMPI 


The mean MMPI profiles are pre- 
sented in Table 1 together with data on 
university student activity leaders re- 
ported by Williamson (1952). Scores 
include the K correction.. Both men and 
women volunteers are higher on K and 
lower on D and P¢ than are Williamson’s 
subjects; in addition, male volunteers 
are higher on the Mf scale and lower on 
Hs. Both men and women volunteers 
were lower, usually significantly lower, 
in variability on the scales with the ex- 
ception of the women on the Hy, Mf, 
and Pa scales. There were few of the 
profiles which would be judged atypical, 
a finding which was corroborated by the 
psychiatric interviews in which fewer 


than 2% were dropped for psychiatric 
reasons. 


From these data we infer that these 
subjects are stron 


a favorable impr 


gly motivated to make 
ession. The low D and 
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Pt scores are indicative of an vsti 
optimistic outlook with a ee 
sence of anxiety symptoms. Lage 
Mj on males is often found in 3 it 
arts populations and is in ee Ti 
the high esthetic interests of mi E 
which anpear on the Study of Values. 


SVIB 
F P re- 
The results for SVIB A P: a 
sented in Table 2. The percentag 


ivi letter 
each group receiving an A or B+ 


score is an indication of their or 
of interest to each occupation. T ects, 
sults are noteworthy in several EAP 
particularly for the groups of OC high 
tions with which many show A 
similarity of interests. P 
The men show high intenet ire- 
Group V type of occupations P porket 
quent A scores on the social directo" 
public administrator, personnel 
and social science teacher gales, si 
also have high scores on the, mi scales: 
psychologist, and the physician est for 
There is a secondary area of ee y 
many volunteers in the Group X rising 
tions of journalism and = of the 
They are unusually low on mos 


in the 


cians 


TABLE 1 


MEAN or MMPI Prorirrs or PEACE Corps VOLUNTEERS 


K 63** +. 6 gt ogee 
Hs 51** 47.9 49 
D 49** + § gx 4744 
Hy 59 +6.1* 56 
Pd 58 +84 54 
Mf 66 4.9.7 50 
Pa 55475 35 
Pt S5** + 6.64 50** 
Sc 58 +7.0** 54 
Ma 59 +8.2* 37 


2 Data from Williamson and Hoyt (1952), 
*p<.05. 
Lei 


(K correction included) 


Male activity 


$ 
leaders # leaders 5) - 
(N = 467) ae 
= C id a 
+ 70* 594+ 8.5 hie 6.6 
z sars 54+ 7.5 48 8.1 
+ 6.8** 52+10.0 ssa 12 
=11.0** 58+ 7.0 iye 9.3 
= 8.2* 58+ 8.8 you 89 
+13.2** 61+ 9.9 s4: 7.9 
t 9.2* 54+ 7.5 eq 76 
+ 5.9** 57+ 9.4 Ret 7.8 
+ Sya 57+ 8.9 274103 
+ 8.5** 59+ 9.7 se 
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TABLE 2 
_Male Peace Corps 1 volunteers (v= = 167) Female Peace Barns volunteers (V = 161) 
2.4 Group occupation A and B ja Group occupation Aand B+ 
I. Artist a5: Artist “410 
Psychologist (Rev.) 55.1 Author 33.5 
Architect 28.8 Librarian 39.1 
Physician (Rev.) 47.9 English Teacher 0 
Osteopath 28.2 Social Worker (Rev.) 79.5 
oust 3.6 Psychologist 45.9 
Veterinarian 1.2 Lawyer 41.0 
Il, Mathe: P Social Science Tcacher 13.6 
hà maticiz 5.2 pate 
inise ician ie YWCA Secretary 0 
Engineer 66 Life Insurance Saleswoman 1.2 
hemist 84 Buyer _ 0 
Il, p = ý Housewife 1.2 
= Toduction Manager 11.4 Elementary Teacher 10.0 
Iv, Farmer 12.0 Office Worker 7.4 
Aviator 138 Stenographer or Secretary 22.3 
Carpenter 24 Business Education Teacher 5.6 
Printer 318 Home Economics Teacher 6 
Mathemati , Dietitian 6 
Science oie ical 28 Physical Education Teacher 6 
austria) Arts Teacher 13 Occupational Therapist 26.1 
Scational or Agricultural Nurse ” 5 a8 
eacher s4 Mathematics or Science Teacher 6 
Policeman 10.2 Dentist 9.3 
Orest A z% Laboratory Technician 6 
5 Service Man 15.0 Physician 22.9 
Vv. YMCA ; y 
Di Physical Education Musician Teacher 0 
irector 22.8 Musician Performer 38.5 
ace Director 57.5 
lic Administrator 81.5 
Soc Secretary 36.6 
“ial Science in High School 
ci cacher 58.7 
Ri School Superintendent 42.5 
cial Worker 80.9 
Te nal 33.0 
M 
vu usician (Performer) 62.9 
mo SPA 
vin, Sen; 7.2 
rior CPA 33.6 
countant 78 
ce man 16.2 
Urchasin ’ 
Banker g Agent i 
Ortician 3.0 
Iy ȚŢ macist 3.6 
= Manager 9.6 
Li Estate Salesman 16.8 
Ña Nsurance Salesman 31.2 
i setting Man 53.2 
yer 
28.8 
ut 
Xy, p thor-Journalist 48.5 
resi 
sident of a Manufacturing 
~ Soncem 6.0 as 
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occupations in Groups IT, TV, and VIII 
or the scientific, technical-applied, and 
business areas. 

The women showed patterns most 
like those of successful social workers, 
psychologists, lawyers, and artists. A 
smaller number showed interests which 
resembled those of librarians, authors, 
and musical performers. Their interests 
were particularly unlike those of buyers, 
dietitians, laboratory technicians, insur- 
ance saleswomen, YWCA secretaries, 
housewives, and the several areas of 
teaching. These women have a pattern 
of interests that is infrequent among 
college students. Although their interests 
resemble those of social workers, they 
had not chosen this as a career. It would 
appear that the blend of patriotism plus 
service that Peace Corps offers has 
Proven attractive to these women. Their 
low measured similarity of interest to 
most teachers Suggests that they will 
not derive their primary satisfaction 
from their teaching per se, 

With both men and women we can 


assert that there is little similarity of 
interest to those engagi 


4 ged in sales, busi- 
ness, or science, Rath 
women have strong soc 
tions, a profound co 
welfare, It should be 
of these volunteers h 
tional liberal arts pro 
more than a half do 
indication of social work or a cognate 
field as a career. It is inferred that Peace 
Corps activity, as they see it, i 
an activity more congenial t 
terest pattern than was th 
major. From these profiles 
infer that some of these volunteers might 
enter the service of the Agency for In- 
ternational Development or the State 
Department, but it does not appear that 
many will be attracted to a career in 
business here or abroad. 


Further light is shed on these data 


er, both men and 
ial service motiva- 
neern for others’ 
recalled that most 
ad followed tradi- 
grams and that not 
zen had given any 


s for many 
© their in- 
eir college 
we would 
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by the impressions gained from Br 
vidual interviews. The males a = 
sample showed a high instance of sc | 
tional indecision. Peace Corps exp pi 
ence was an opportunity to pE 
pects of their interests and at yor ye 
time gave them more time to ma Hom 
career choice. The women, for W ash 
career choice is a different a ote 
commonly reported that the Peace is 
Was an opportunity to do someramg mat 
nificant, an opportunity which wa ane 
otherwise open to them. With both 
and women service motives, Age 
expressed, constituted a central th 


Study of Values 


T cea 
The results of the Allpo.t-Verr 
Lindzey Study of Values are pre lege 
in Table 3 together with data OF jernon 
students reported by Allport, trast t0 
and Lindzey (1960). In con mor 
MMPI data, the volunteers E al 
variable than college students . pow 
scales except the political , cant 
ever these differences were se a sca 
only in the case of the ae for 
for males and the political sca rison? 
both males and females. Com dents 
between volunteers and college = on all 
show a significant mean seat scales 
except the political and on nen 
for men and the social scale eis dif- 
The practical significance of t pecaus®? 
ferences is difficult to determine i yed, 
with samples as large as those Jar sta” 
small absolute differences ons n, t® 
tistically significant. In oie ivi m 
method of scoring whereby an i tan 
al’s total score must sum to 4 i 
Causes scores on one scale to o É 
cally affect scores on some ot F 
making comparisons difficult. ind, ih 
With these restrictions in A untet”? 
Outstanding characteristics of y w score 
on this test seemed to be their 10 ores e a 
on economic and their high So inte" 
esthetic interests, Low econom 
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ests would be expected from a group 
who have volunteered for a low paying 
i activity. The social scale of this 
ai contains items emphasizing philan- 
ot . and love of people which were 
sat n adequate expression of the social 
otivations of this group. The high 
rin interest reported is consonant 
a a ae education and with 
inl igh interests on the musical and 
k al linguistic scales of the SVIB, 
oups VI and X. 


Q Sore 


teak results of 100 male and of 100 
Pan subjects were analyzed by inverse 
and ee. Four factors for males 
to be Ted factors for females appeared 
Sons so terpretable, Hypothetical per- 
Se were generated for these 
— en These were included with 
ake já males and 47 new females to 
“Sna eea 100x100 matrix of per- 
will be e results of this last analysis 
the aue ated here. The factors from 
computi rse analysis were interpreted by 
item ng the correlation between each 
and each factor. 
analysis of the third matrix 
10 interpretable factors, which 
d for 61% of the variance. The 
Selves = these factors, which by them- 
accounted for 37% of the vari- 


ance, were clearly replications of factors 
which had been found in the two previ- 
ous matrices. 

The items which correlated most 
highly with Factor I are shown in Table 
4. This factor is a group whose expressed 
motivations emphasize learning and new 
experience with a tendency to minimize 
service to others. 

Factor II, with appropriate items 
shown in Table 5, is made up of indi- 
viduals whose motives polarize around 
an assertion of anticommunism and a 
desire to enhance our own country’s 
prestige abroad. There is a minimiza- 
tion of the extent to which the volunteer 
himself will be influenced by this ex- 
perience. 

Factor III (refer to Table 6) includes 
persons who make a strong assertion of 
personal idealism and altruism and who 
are not seeking much personal gain from 
this experience. 

The remaining factors were small with 
very few persons showing high loadings 
on any single factor. They included mo- 
tives organized about patriotism, a de- 
sire for personal growth, and a drive for 
novel experience. Further examination 
of these data indicated that there were 
no consistent sex differences in responses 
to this inventory. 

An R analysis was also performed on 


TABLE 3 


EAN § 
See OF VALUES Scores or Peace Corps VOLUNTEERS COMPARED WITH A COLLEGE SAMPLE 


Male Female College College 
Seal, volunteers volunteers males * females & 
The > (N = 131) (N = 131) (N = 2,489) (N = 1,289) 
ee k apes a 3M 
Econ tical aera 82" 40.6%" 47.5 43.8473 35.8472 
Aegty ic 321% 86 29.9%* + 7.4 42.8479 37.9473 
Socia Ue 44.8t*4 93 49.3**+9.0 35.148.5 42.7+8.3 
Polit 40.8**+ 7.2 41.2 +75 37.1470 42.0+7.0 
Ration 428 + 5.6** 30.78 5.5% 43.0 + 6.6 37.846.2 
os ` 38.1 +10.2 39.2** + 9.9 38.2493 438494 


m 
te 2 <lodliport, Vernon, and Lindzey (1960, p. 12). 
<o 
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TABLE 4 
ITEMS CORRELATING HIGHLY WITH Factor 1 
Item r 
number Item 610 
46 This experience would help me in my career, 
26 I want to develop an understanding of other peoples from first hand 606 
contact. $e 
43 I want to understand world affairs better and I can do so by working in 595 
another part of the world. 387 
62 Professionally I would benefit greatly from this experience. 532 
34 I look on this as a worthwhile opportunity to travel, 567 
58 My personal beliefs involve unselfish service to others, L329 
42 I have a personal conviction that I should help others. 519 
22 I want to lose myself in some unselfish service to others. —516 
18 My greatest satisfaction comes from serving others. — 463 
05 My life is not complete without service, apa 
TABLE 5 
Items CORRELATING Hicury wiru FACTOR 2 ae 
“‘Ttem = a i 
p 
number Item npa” 
nesin — = a ~~ 34 
24 I want to do my part in defeating communism abroad. 592 
57 The Reds are sending people to these countries, I want us to do the same. 
72 Wogan defeat communism by proving that we have something better to 579 
offer, 
89 í ie like to let the world know the real value of the American way 550 
of life. 5 
535 
41 I want to help save underdeveloped countries from going communist. 
48 I will emerge from this with a much clearer idea of the person I 554 
want to be. T4 
75 want to be the different person that this service would make possible a 
20 A change from the things I have been doing would make me a better 487 
Person, as 
s —461 
11 I want the perspective that this experience would give. —458 
B _ This experience would help me become the kind of person I want to be. 
TABLE 6 
7 Items CORRELATING Hicury wir Factor 3 
f Item r 
number Item -i 
3 Po k ee z 
73 This service is an expression of the values which I hold most important. 722 
97 This is one of the truest expressions of my belief, 584 
42 I have a personal conviction that I should help others 551 
58 My personal beliefs involve unselfish service to others. 548 
25 I feel that we have a responsibility to others to help them personally 243 
38 I will be able to do a better job at home after I have had this experience _ 440 
46 This experience would help me in my career, 7425 
04 I want to be able to earn the admiration of others. —410 
70 I want to help improve the image of t 
43 i 


etter and I c by working 400 
in another part of the world, an do so by 
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a Q sort responses of 330 subjects. 
: ms tended to group around 12 distinct 
actors: (a) professional enhancement 
bi idealistic altruism, (b) improving 
i € mage of the United States, (c) guid- 
hg others to a better way of life, (d) 
oa for travel, (e) earning the respect 
bag ers, (f) finding one’s self, (g) con- 
ie P with overseas experi- 
ing (4 atoning for mistakes, (i) pay- 
Gh n owed to the United States, 
elping Ping to defeat communism, (4) 
() a ss „to help themselves, and 
Serie pe a to sacrifice in order to 
sharpl m of these factors is relatively 
sults i efined. When comparing re- 
i he R and Ọ analyses, it appears 
Way People are grouped according to the 
m which they respond to combina- 


tion, 
S of several of the factors from the 
analysis, 


DISCUSSION 


pt ence Corps offers the first op- 
Mine Bi for social scientists to deter- 
Which a reasonably large N, factors 
assienm uence persons to seek overseas 
Ucces eh and factors which influence 
slul performance, The importance 

han, S Problem is accentuated by the 
that can be done to international 
ns by serious failure of this pro- 
CUlture wig discontinuities of the alien 
ditiona te our own cast doubt on tra- 
bles, Prediction and selection varia- 
ing nly careful research will deter- 
Oversa, © degree to which performance 
1S a function of long standing 


Ts 
Der eas 
ty and attitude variables and 


Sonali 


how much it is a function of recent situ- 
ational and training variables. 

Data collected during training on 331 
volunteers indicate a high incidence of 
social service interest patterns on SVIB. 
However the subjects reject the more 
philanthropic expression of social values 
on the Study of Values. The MMPI 
data suggest a low incidence of symp- 
toms of anxiety. An elevated K scale 
suggests a strong emphasis on appear- 
ing symptom free. 

Persons with high social service mo- 
tives and interest in welfare are faced 
with the problem that our society does 
not accord high status to many of the 
occupations in which their interests can 
be best expressed. In contrast to careers 
in science or business, careers in social 
service occupations are not made as at- 
tractive or as remunerative. In spite of 
its low salary scale, the Peace Corps 
offers these people an opportunity to ful- 
fill some of their most deeply felt pur- 
poses, an opportunity which is often not 
found at home. The impact of this ex- 
perience on their subsequent careers will 
warrant careful observation. 
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SOME NONCOGNITIVE CHARACTERISTICS OF 
HONORS PROGRAM CANDIDATES? 


D y NES.? L: NCE SIEGEL, AND 
A ICK J. CAPRETTA, REGINALD L. JONES,? LAURENC 
eee LILA C. SIEGEL 


Miami Univ 


Noncognitive personality characteri 
experience with a university Honor 
of 3 standard personality inventor: 
As a group, successful Honors stu 
oriented toward academic work 

unsuccessful Honors students and t 
Program were decidedly more praci 
relatively constricted in thought. 

hypothesized characteristics, such 

and kind of classroom thinki 
join is more important than 


distinguishing among the groups of 


a 


This study grew out of an attempt to 
develop an improved set of criteria for 
selecting Honors Program candidates at 
Miami University, Oxford, Ohio. The 
particular program under considera 
is typical of other attempts at var 
colleges and universities to offer an 
portunity for students of high acade 
ability and seriousness of purpose to 
roll in special courses and seminars 
vised to provide a 
these students than 
regular courses alone, Emphasis in such 
a program is placed upon independent 
study, and the development of critical 
thinking and creative 


tion 
ious 
op- 
mic 
en- 


de- 
sreater challenge to 


is possible through 


capabilities, 
Present selection Procedures at Mi- 
ami University consist Primarily of 


“cognitive” predictors, i.e., high school 
graduating class standing, college course 
grades (for upperclassmen), and apti- 
tude test scores. Although it has been 
suggested that school grades do reflect 
more than the student’s abilit: 


7 y (San- 
ford, 1962), little systematic attempt 
has been made to supplement these ob- 


1 The cooperation of the Honors P 
Office at Miami University, Oxford, 
fully acknowledged. : 

? Now at Fisk University. 


rogram 
is grate- 


versity, Oxford 


stics of 126 students having had some 
s Program were ascertained by means 
ies and 2 locally devised instruments. 
dents were found to be intellectually 
and rather flexible thinkers; while 
hose electing not to participate in the 
tical in their approach to college and 
No differences were found on other 
as motivation in academic situations 


ng. It is suggested that the “decision” to 
“success” or “failure” in the program in 


students. 


ing 
pe: ae reer i arino 
jective criteria with information beat! 


siga” yarla 
e” v 
on the so-called “noncognitiv alues, 


stics- 


yi 


‘ace 


ege 
teristics of various groups © ciation 
Students having had some associ i 


Hypotheses dy 
+. stu 
The hypotheses tested in this 7 jth 
stem from preliminary interview a 
13 students representing the ¢* roup®’ 
of each of three groups. These & con 
to be described in more detail late", ome 
sisted of students all having ha 
contact with the Honors Progra 
Miami University, : 
Careful Sky of the interview! or 
vealed what appeared to be a “P 
of approach” to academic work 
cessful Honors students. These 1 
Seemed to be highly motivate¢ 
268 


» fol OWin, 
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drive for personal recognition in aca- 
demic situations. However, this motiva- 
a was coupled with a willingness to 
Shee e n amount of personal risk 
am. 7 virtue of entering a new pro- 
that ; there was at least a possibility 

A their grade-point averages might be 
Sac affected. Furthermore, the in- 

wer was struck by what seemed to 
ie nalion within this group to 
cations ivergently, i emphasizing impli- 
nn “i = generalizations rather than 
sehfatine ual acquisition. Finally, repre- 
enjoyme this group often voiced their 
nities i oe appreciation of opportu- 
me 5 independently of the usual 

structure. 

a pi the overall picture suggested by 
dna s was that successful Honor 
mature ere as a group, personally 
thinkers See, and rather flexible 
ern San n order to examine this pat- 

€ systematically, we induced the 
& five hypotheses: 


iss Successful Honors students (Group 
inatio demonstrate greater self-deter- 

an will and independence of thought 
AU) a J mnccesstul candidates (Group 
Not ts fot those students who decided 
Were , ae the Honors Program and who 
Cours Uccessful in their non-Honors 

es (Group DS). 

ome reces in thinking “style” will 
mor such that Group AS will ap- 
ught e fluent and less constricted in 
and Dg and belief than will Groups AU 


entog zoup AS will be conceptually ori- 
Gropp, ° Ward academic work, whereas 
Set j n AU and DS will have a factual 
Similar situations. 

wee AS will value intellectual 
«etic pursuits over and above 
Cerne , Practical” and traditional con- 
°F the © a greater extent than will either 
pince Other two groups. (Specific ref- 
Y the 7 made here to values measured 
llport-Vernon-Lindzey Study of 


Values, viz., Theoretical, Aesthetic, Fco- 
nomic, and Religious subscales.) 

5. Group AS will demonstrate a higher 
degree of motivation in academic situa- 
tions than will Groups AU and DS. 


METHOD 


Subjects 

One hundred and twenty-six lower division 
students at Miami Unive: comprised the 
three groups tested in this study. Definitions 
of certain terms will be helpful preliminary to 
listing these gréups. Invitations, for the indi- 
viduals under consideration, were given to 
those students who stood in the upper 10% of 
their high school graduating classes and re- 
ceived a raw score of 99 or higher on the 
American College Testing Program Composite. 
Success, for the same students, refers to a 3.25 
(A = 4.0) or higher grade-point average made 
during the students’ first semester (or in some 
cases the first two semesters) in the Honors 
Program at Miami University. 

Group AS consisted of 49 students (17 males 
and 32 females) who had accepted invitations 
to join the Honors Program and who were suc- 
cessful subsequently in their scholastic work. 
Group AU, on the other hand, comprised 51 
students (14 males and 37 females) who had 
accepted invitations to join the Honors Pro- 
gram but who were unsuccessful (ie. grade- 
point average below 3.25) in their scholastic 
work. Group DS consisted of 26 students (10 
males and 16 females) who declined invitations 
to join the Honors Program and who were 
successful in their non-Honors scholastic work. 


Tests and Measures 


The general research plan was to determine 
the validity of the foregoing hypotheses by 
means of various testing instruments which 
have either been demonstrated in previous re- 
search to be applicable to the present study, 
or appear, on purely logical grounds, to be 
appropriate measures. The five instruments 
that were administered are listed below. Gen- 
eral descriptive information is offered only for 
those measures which have been developed 
locally. 

1. Allport-Vernon-Lindzey Study of Values 
(AVL; 1960). Only four of the six basic 
values measured by this scale are germane to 
the present study: Aesthetic (Ae), Economic 
(Ec), Religious (Re), and Theoretical (Th). 

2. California Psychological Inventory (CPI; 
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1957). Only four of the 18 subscores 
gt Beale this study: Achievement via 
Independence (Ai), Flexibility (Fx), Psycho- 
logical-Mindedness (Py), and Self-Acceptance 
—— of Time Intervals Inventory 
(ETI). This inventory, developed by Siegel 
(1957), purports to be a generalized measure 
of drive level in terms of expectancies regard- 
ing the passage of time. The subject is re- 
quired to estimate the amount of time that 
has elapsed between a pair of events, Each 
item pair consists of a statement of two events 
which might be expected to transpire succes- 
sively—e.g., (a) Enters college. (b) Is recog- 
nized by the faculty as an outstanding student, 
No restrictions are placed upon the response. 
Subjects may respond in terms of any unit of 
time measurement they consider to be appro- 
priate. The rationale for ETI is simply that 
high drive level (to be construed as “motiva- 
tion” here) is revealed by short-time estimates. 
The inventory is scored in five homogeneous 
and relatively independent categories desig- 
nated: Familial Activities, Heterosexual Ac- 
tivities, Scholastic Activities, Social Activities, 


Of particular con- 


tions of items or highly revi 
OPI is particularly geare 
and yields 13 subscores, 
repetition of kinds of subt 
subscales were given, Complexity (Co) and 
Thinking Introversion (TI). Testing time for 
this abridged version of OPI is about 15 
minutes. 

According to the recently Published OPI 
manual, the complexity measure is related to 
an “experimental” orientation, High scorers 
are tolerant of ambiguities, are fond of novel 
situations and ideas, and are aware of subtle 
variations in patterns of stimuli, while Jow 
scorers require structure and function best in 
well-organized situations. Persons Scoring high 
on the Thinking Introversion measure are 
characterized by a liking for reflective thought 
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and display an interest in a variety of Tun 
their own sake, whereas the low scorers tend 1 
evaluate ideas on the basis of their prach 
immediate application. This last meas 
pears to reflect a general appreciation 0 
interest in scholarly activities. n 
5. Set Toward Education Scale (ESS). tee 
scale, devised specifically for research in vo 
education ky the Instructional Research i ide 
ice at Miami University, is a forced-cl Fes 
inventory yielding scores on a continu) ae 
characterized on the one hand by a precer 
sition to learn isolated facts (factual sct) ear 
on the other, by a predisposition to see 
principles, relationships, fact clusters, and C 
cepts (conceptual set). r e 
The alternatives aeolian each nad Se 
paired on several different preference in you 
including judgments about “how bright: J o 
have to be to learn this” and “the kini 
impression knowing this would make San 
naive person.” One triad with its saat 0 
weights will serve to illustrate the form! 
this inventory. 


in 
Items 70-72, Assume you are enrolled 
a Natural Science course and mei erst 
about the following. Which one will 7 you 
you most? Which one will interes 
least? 
Scoring 
Most Lee 
= 


70. The names of the cle- 
ments included with the “hal- 


1 
ide” group. = 
71. Statement of Newton’s 0 
Third Law of Motion. s 


72. The significance of a pH caf 
of 6. 1 


to 
This scale requires about 15 minutes 
administer and yields one score. various 
Predicted group differences on the e sum 
test variables for the five hypotheses a” 
marized in Table 1. 


Testing Procedure the 


f 
Arrangements for testing as many ossible 
subjects in each of the three groups as P site 
ee o! 
*A copy of this scale has been pee ute 
with the American Documentation usxil- 
Order Document No. 7692 from ADI / ation 
iary Publications Project, 
Service, Library of Congress, Wami po 
D. C. 20540. Remit in advance a make 
microfilm or $1.25 for photocopies plicat? 
checks payable to: Chief, Photo 
Service, Library of Congress. 
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TABLE 1 


PREDICTED Direction or Group DIFFERENCES ON THE Various TEST 
VARIABLES FOR THE Five HYPOTHESES 


hi 3 
Hy _ Appropriate 
Ypothesis test variable Predicted direction of group differences on test subscales 
1 CPI and OPI AS>AU and DS on Achievement via Independence and Self- 
Acceptance of CPI and Complexity and Thinking Introver- 
2 ei sion of OPI a 
3 ESS AS>AU and DS on Flexibility and Psychological-Mindedness 
4 AGL AS > AU and DS L 
AS > AU and DS on Theoretical and Aesthetic 
5 EN AS < AU and DS on Economic and Religious 
: AS> AU and DS on Scholastic Activities 
Note— 
decline m AS cepted invitation, successful; Group AU—accepted invitation, unsuccessful; Group DS— 


Wer 
to bale a by sending notices and reminders 
approxim padent, From an available pool of 
icipated ately 175 subjects, 126 actually par- 
Subjects iat the testing program. Of the 49 
tom Giom tested, there were 8, 21, and 20 

Wo to ps AS, AU, and DS, respectively. 

the test 3 hours were required to complete 
approxima ee? the average time being 
ae mad 2.5 hours. The majority of sub- 
a 2 ested at one time and remaining 
Small groups spread over a 2-week 
4 cd the most general instructions were 
e subjects. They were assured that 
i ai collected were for research pur- 
Property >p Pd would be the confidential 
Ice, Em 4 the Instructional Research Serv- 
their eit asis was placed upon the need for 
tion op OUS cooperation toward the comple- 
Perative a, research. Most subjects were CO- 
Were doin nd appeared interested in what they 
of the feats In the few cases for which all 
is er ject Were not completed at one time, 
Sometime S were required to return later 
S a week later) to finish the battery. 


Statics: 
tistical Analysis 


Majo 5 
teo, s she tical evaluation in this study was 
Nalysis a through use of a group-by-sex 
ate Ncies in variance design. Unequal fre- 
Lew SPecial the subclasses necessitated the use 
ee 3) Procedure described by Walker and 
pyres Were. Standard scores rather than raw 
Dae, Tesult. used for the statistical analysis. 
able g S of this analysis are presented in 


N lig 

fer ligh 
cae ces a of previous research on sex dif- 
, r Teeman & Miles, 1950; Todd, Ter- 
ank, 1962), analysis by # test for 


individual groups of males and females treated 
separately was also made. Probabilities, shown 
in Table 3, are based upon one-tailed tests. 


RESULTS 


Hypotheses 1 and 2 


Hypothesis 1, that successful Honors 
students (Group AS) will demonstrate 
greater self-determination and independ- 
ence of thought than will the unsuccess- 
ful candidates (Group AU) and those 
students who decided not to join the 
Honors Program (Group DS), was 
largely not supported. No significant 
differences are shown in Table 2 be- 
tween the responses of the three groups 
on the Achievement via Independence 
and Self-Acceptance scales of CPI or 
the Thinking Introversion scale of OPI. 
What little support there is for this 
hypothesis appears in the comparison 
between Groups AS and DS on the 
Complexity scale of OPI (F=3.98, df 
=1/70). It is important to note that 
additional partial support is found for 
this hypothesis when the results for the 
male subjects are treated separately 
(see Table 3). Males in Group AS 
made significantly higher mean scores 
on the Achievement via Independence 
and Self-Acceptance scales of CPI and 


TABLE 2—Continued 


Significance level 


AU 


HP unsuccessful 


Group and sex 
interaction 


g 
A 
i 
a 
g 
Fj 
S 
3 
a 


successful 


2 
= 
a 


Female 


(WV = 10) (V= 16) 


Male 


AS-DS  AU-DS 


AS-AU 


AU-DS 


AS-AU AS-DS 


gn 
9 
a 
a 
> 
= 
h 
< 
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ns ns 


ns 


ns ns .01 -01 .01 


ns 


42.9 


ns 


ns 


-01 


01 


ns 


ns ns 


ns 


.05 


OL 


ns ns 


ns 


2.47 
5! 


| 
| 
| 
| 


aller than those given 


N for some vi 


cal analysis. 


a 


1 and SD are given in raw score units. St 


the Complexity scale of OPI than did 
males in Groups AU and/or DS. The 
only significant difference found for fe- 
males on these same measures is in 
the opposite direction to that hypothe- 
sized (i.e., Self-Acceptance, Groups AS 
and DS). 

Support for Hypothesis 2—that 
Group AS will be less constricted in 
thought and belief than Groups AU and 
DS—is evident in scores on the Flexi- 
bility and Psychological-Mindedness 
scales of CPI. Group AS obtained sig- 
nificantly higher mean scores on these 
scales than did Group DS (Flexibility: 
F=4.00, df= 1/71; Psychological- 
Mindedness: F=5.01, df=1/71). In 
treating the sexes separately by ¢ test, 
significant differences were found on the 
Psychological-Mindedness variable for 
males comparing Groups AS and AU, 
and Groups AS and DS. 


Hypothesis 3 


In this hypothesis it is stated that 
Group AS could be characterized as 
being conceptually oriented toward 
academic work, while Groups AU and 
DS would have a predilection favoring 
the accumulation of facts in similar 
situations. In light of the nonsignificant 
group differences shown in Tables 2 and 
3 for ESS, this hypothesis is not sup- 

orted. However, it should be men- 
tioned that all of the groups considered 
in the present study have appreciably 
higher ESS scores (i.e, more con- 
ceptually oriented) than do lower 
division Miami University students in 
general. The mean ESS score for the 
latter group is approximately 8, con- 
siderably below that of any of the mean 
ESS scores reported in Table 2. A posi- 
tive correlation between ESS and 
scholastic aptitude might help to explain 
the negative findings with respect to 


Hypothesis 3. 


4 Capretta, Jones, SIEGEL, AND SIEGEL 
27. 
TABLE 3 
RESULTS OF £ Test ANALYSES # r 
Test variable cakes ee 
ü An DA AAT ETI 
Group CPI OPI AVL ees 
= Te eee a =a Ge holastic 
Ai Fx Py Sa Co TI Ae Ec Re m Coe. 
ASR AY z yee us 
Male 1.72* as 2.86%* ns ns ns ns ns ns ns 345 1.73* 
Female ns ns ns ns ns ns ns ns 3.15** ns ns 
AS and DS . se 
Male 2.03* ns 4.46** 230% 3 agus ns ns 1.71% ns 2.12 i 
Female ns ns ns, 211b ns ns ns ns ns ns 
AU and DS n 
Male ns 194% ns 181* 245%* ns ns ns ns ns ns sie 
Female ns ns ns ns ns ns ns ns ns ns us 
poeta as follows: AS and AU, males = 29, females = 67; 
» Males = 22, 


* These #’s were Sampat 
b This probability value 

other specified Probability 
fp 05. 


i 201. 


ed from M and sp da 
represents a signi 
values are in the predicted 


Hypothesis 4 


s is quite Specific in 
The 


ences in the 
so found be- 
tion on Eco- 
F=8.89, dj 
F=22.17, 
1 (Groups 
6; Groups 
=1/70) sub- 
variance also 
fferences be- 
les, especially 
roups AS and 
=1/96; Groups AS 


indicates appreciable di 
tween sexes on these sca 
on the Religious scale (G 
AU: F=17.55, df 


and 
25, females = 46; AU 


AS and DS, males = 


ps 
and DS: F=24.12, df=1/70;_ es 
AU and DS: F=20.25, 5 ge ee 
the Theoretical scale (in the ai, 
order given for Religious: F=20.3 6.23; 
=1/96; F=16.90, dj=1/70; ceil 
4f=1/72). For the former AVL igher 
the females scored consistently = 
than did the males, whereas the rev 
Was true on the Theoretical scale. By 
The analysis of AVL results cot- 
test, shown in Table 3, proviak in 
roborating evidence that the ma othe 
the three groups differ from one 7 four 
more so than do the females. A s are 
of the significant mean ae 
in the predicted direction for the m the 
while only two are significant and Í 
tight direction for the females. 


Hypothesis 5 


«se wad 

According to this hypothesis, it AS 
Predicted that subjects in ee a 
would demonstrate a higher a s 
motivation than would el 
Groups AU and Ds. Of the © 
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&roup comparisons for the Scholastic 
scale of ETI, shown in Table 2, there 
E a significant differences, though 
A ould be noted that all of the dif- 
in nces are in the predicted direction. 
ìs also interesting that all of the com- 
‘oe between sexes presented in this 
€ resulted in significant differences 
{ots AS and AU: F=8.01, dj= 
mgt Groups AS and DS: F=6.30, df 
Pee Groups AU and DS: F=4.52, 
=1/63), 
on only significant t test in Table 3 
ting 2 to ETI was found in com- 
and ai emales in Groups AS and AU, 
difecti is difference is in the predicted 
tion. 


s DISCUSSION 


Pi results of this study provide 
Ypoth support for three of the five 
eae and thus, in some measure, 
cessful a successful from unsuc- 
ose Wt Onors Program students and 
gram i decided not to join the pro- 
Hie mace ae presented in Table 3, 
pon oh ts differ somewhat depending 
cant ditte sex of the subjects, signifi- 
ion bej erences in the predicted direc- 
Daris g found in 10 of the 24 com- 
of the for male subjects and in only 
jects, ay comparisons for female sub- 
findin tese results, along with similar 
Mites in other studies (Freeman & 
em ae Todd et al., 1962), serve 
Sideting asize the importance of con- 
re 8 sex differences in such research 
Presented here. 
Sex * might be expected, the significant 
Group interactions on test 
Achievement via Independ- 
i Self-Acceptance Complexity, and 
< Coretica] eg , p , f 
Similari al indicate some degree © 
dissin aty among groups of females and 
th se tity among male groups for 
d ‘ne In all four cases the 
Progr Sful group of males in the Honors 
am scored higher than did the 


Vari 
able 
Ence S 


unsuccessful male group and/or those 
males who decided not to join the pro- 
gram; while little, if any, difference is 
noted for the three groups of female 
students. 

Both types of statistical analyses dis- 
closed greater discrepancies between the 
successful Honors and non-Honors 
groups than between the successful and 
unsuccessful Honors groups. Table 2 
shows significant group differences in 
the predicted direction on six of the test 
variables for comparisons between the 
former pair of groups and only two for 
the latter pair of groups. Likewise, 
results presented in Table 3 indicate 
eight significant #s in the predicted 
direction for comparisons between the 
former two and only five significant 
mean differences for the latter two 
group comparisons. Also bearing on 
this relationship are the differences 
found between the unsuccessful Honors 
and successful non-Honors groups on 
test variables Flexibility, Self-Accept- 
ance, and Complexity presented in 
Table 3. In all cases, males in the un- 
successful Honors group had the higher 
mean score, i.e., were more flexible, self- 
confident, etc. In short, students who 
decided not to join the Honors Program 
and who were successful in their non- 
Honors courses differ from those who 
joined and did well more than this 
latter group differs from the Honors 
students who were unsuccessful. The 
implication here is that “decision” 
rather than “success” or “failure” is 
more important in distinguishing among 
groups of students on the test variables 
considered in this research. It is un- 
fortunate that the present study did not 
include a fourth group of the declined 
invitation, unsuccessful. 

An interesting parallel is seen between 
the successful Honors students in the 
present study and the gifted student in 
the Warren and Heist (1960) study on 
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gifted college students. This latter Te- 
search describes the typical gifted stu- 
dent as being strongly attracted ; to 
intellectual activity combined with high 
levels of esthetic awareness and ap- 
preciation. Present results on AVL 
demonstrated that the successful Honors 
women (as was also true for Warren and 
Heist’s gifted women), in contrast to 
the men, value the Aesthetic orientation 
slightly more than the Theoretical, while 
sharply rejecting the Economic. 

The fact that the female subjects 
made consistently highet motivation 
scores on the Scholastic scale of ETI 
than did the male subjects bears upon 
a hypothesis suggested by McClelland, 
Atkinson, Clark, and Lowell (1953) 
that a higher level of scholastic per- 
formance is expected of girls than boys 
at all levels of development. The higher 
Scholastic score for females is perhaps 
a manifestation of this expectation, 
This supposition has some support in 
the general finding that scholastic 
underachievement is more frequently 
found in males than females (Todd 
et al., 1962), 

That personality characteristics other 
than high academic aptitude do dis- 
tinguish the intellectually gifted from 
the general population seems clear from 
previous research (Warren & Heist, 
1960). The results of the present study, 

» permit an extension of 
finding to include distinctions 
within the so-called gifted group itself, 
Not only do noncognitive variables seem 
to play some role in determining suc- 
cess in an intellectually oriented pro- 
gram but, more important, perhaps, is 
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the difference between superior students 
who accept invitations to join such pa 
grams and those who do not on thes 
same variables. 
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VOCATIONAL INTEREST IN RELATION TO 


VOCATIONAL MOTIVATION 


JOHN O. CRITES 
University of Iowa 


This study evaluated the general proposition that vocational motives and 
interests are related by testing several specific hypotheses about the 
expected correlations between 7 motivation factors and the occupational 
scales of SVIB in a sample of 130 male undergraduates. Product-moment 
r's and analyses of variance supported most of the hypotheses and led 
g conclusions: (a) kind, but not strength, of vocational 
motivation is related to interests, (b) each interest area on SVIB is 
associated with a different motivational pattern, and (c) the primary 
motivational factor which differentiates interest types is the bipolar one 


of System versus Social Service. 


Theories of vocational interest have 
P oppsed a number of different hypothe- 
Dh to xecount for the well-established 
eeenomenon of individual differences in 
enoe rational likes, dislikes, and prefer- 
tan (Super & Crites, 1962). Empirical 
Si of the hypotheses, however, with 
A few notable exceptions, have 
Sethe largely inconclusive or noncon- 
Servi results. Strong’s (1943) ob- 
abiliti that “interests reflect inborn 
“ les [p. 682]” has received negligi- 
attitude support from studies of 
lation and achievement variables in 
tion at E interests, the modal correla- 

ane eing close to zero (Darley & 
z ice ee. 1955). Similarly, the relation- 
ca of interest to various aspects of 
Patter ty such as predominant trait 
(Borda (Darley, 1941), self-concept 
ti in, 1943), and response integra- 

(Carter, 1940), have generally been 
lth ES Cottle, 1950; Tyler, 1945), 
retical o sometimes interpreted as theo- 
los Y significant (Darley & Hagenah, 
indin, Probably the most promising 
ha, 88 on the correlates of interest 
bac, Come from investigations of family 


ac] 
iden ground (Carter, 1932) and parental 
Whi ification (Crites, 1962) factors, 


acqui appear to be related to both the 
ìsition and patterning of likes and 
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dislikes. Why these associations obtain, 
however, and what the connecting or 
linking variables are have not been 
established. 


PROBLEM 


One possible way of conceptualizing 
and explaining the development of voca- 
tional interests, which is consistent with 
the above research, is suggested by the 
widely held assumption of practitioners 
and theorists alike that “interests are 
motives.” In both counseling and per- 
sonnel selection interests are often in- 
terpreted as indicative of level of aspira- 
tion, drive, or motivation. Darley and 
Hagenah (1955) write: 
occupational interests reflect, in the vocabulary 


of the world of work, the value systems, the 
needs, and the motivations of individuals 


[p. 191]. 


Likewise, Strong (1955) reasons: 


Interest scores measure a complex of liked and 
disliked activities . . . equivalent to a “con- 
dition which supplies stimulation for a par- 
ticular type of behavior”. . . Interest scores 
are consequently measures of drives. 


Drives or motives can, in turn, be 
related to the social learning conditions 
of the home as expressed in the attitudes 
of the parents toward their children and 
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the goals which they value for them, 
e.g., security, prestige, ‘ job freedom. 
Thus, it may be that motivational varia- 
bles provide the connection or link be- 
tween the formation of differential voca- 
tional interests and the role of the family 
in the socialization process. The prob- 
lem of the present study was to evaluate 
this conceptual scheme by determining 
whether a relationship between inter- 
ests and motives can be demonstrated 
empirically, 


HYPOTHESES 


There has been some research on the 
relationship of values to interests (Fer- 
guson, Humphreys, & Strong, 
Kinnane & Suziedelis, 1962; Sarbin & 
Berdie, 1940) tha 
junction with rece: 


fication of vocational motivati 
(Crites, 


are relatively unstructured, 

2. The need for System in one’s work 
should find expression in SVIB Group 
II occupations, such as Mathematician 
and Engineer, which require method 
order, and planfulness in their perform. 
ance. For essentially the Same reason 
System should also be related to SVIB 
Group II and Group IV Technical 
occupations. 

3. The motivations for Beha: 
trol and Social Service should 
ciated with the Administrative 
(Public Administrator, 


vior Con- 
be asso- 
Contact 
City School Su- 


CRITES 


perintendent, etc.) and Personal Contact 
(Minister, Social Worker, etc.) occupa- 
tions of SVIB Group V, respectively. 

4. The desire for Personal Status, 
which is an egocentric need for recogni- 
tion and social position, should be cor- 
related with interests in SVIB Gronh 
VI (Musician), Group VII (CPA), an 
Group X (Verbal) occupations. m 

5. The need for Structure, or t 
security which comes from an asin 
lished routine and stable organizationa 
Setting, should be related to interests a 
SVIB Group VIII (Business Detai 
occupations, a 

6. Finally, the motivation em 
Material Security should be related bs 
SVIB Group IX and Group XI a 
ness Contact) occupations, in waich ay 
rewards of work are primarily enn 
in nature, e.g., commissions, bonuses, 
visible success, 


METHOD 
Measuring Instruments 


re 
The vocational motivation variables Wing 
measured with questionnaires and eer 
scales which had previously been fometorial 
load the highest on the corresponding fac stru- 
dimensions defined by several different INS - 
ments (Crites, 1961). Material Security» 
cial Service, and System were assessed 
Materialistic, Humanitarian, and l 
scales, respectively, of the Occupation?” per- 
tude Rating Scales (Hammond, 1954) Jucture 
sonal Status, Behavior Control,t and Str nage” 
Were scored from the Status-Necd, Margie 
tial-Aggressive, and Organization-Need Ques” 
respectively, of the Work Satisfaction egom 
tionnaire (Astin, 1958); and, Job Fre Need 
was quantified from the Achieverner endif 
Score of the Job Incentive Rankings ( thes? 
& Stillman, 1958). Typical items fo Towing: 
inventories are illustrated by the fo chang? 
carn big money, be the Top Mam ogie! 
People for the better, use a metho ily 
alta satel 
* The Behavior Control factor was crysis r 
named Social Approval. Further ana the 
its composition, however, has indic? sign” 
change in terminology. The present 
tion was adopted from Caplow (1954). 


VOCATIONAL INTERESTS AND MOTIVATION 


Soak and have good job security. The 
SVIB was used to measure occupational 
~Mterests, 


Procedure 


ro Milk ip measuring instruments were 
Badur cred to a sample of 130 male under- 
Ücipati es as part of thcir experimental par- 
Chiles ie in an introductory psychology 
Brodie o test the hypotheses of the study 
rania t correlation coefñcients were 
motivati between cach of the vocational 
‘nk 4 on variables and the 45 occupational 
or Hr ir upatigAAL scales of SVIB. The 7’s 
6 Me ave group which was comprised 
y E an ra cne scale were then averaged 
strength z ormations. To determine whether 
lon Soa SE as kind of vocational motiva- 
Primary related to interests, the subjects with 
analysed oe randary; and reject patterns, as 
Were Aa Stephenson’s (1961) procedures, 
motivati «pared in cach SVIB group on mean 

indquist scores, using a Type I design 

ist, 1953), 


RESULTS 


M 1 presents the data from the 
terest ca analysis of the vocational 
Proxim and motivation measures. Ap- 
th ately 41%, or almost one half. 
% er's for the occupational scales and 
phen about one third, of the 7’s for 
Cant at qe ational scales were signif- 
For the the .05 and .01 levels or beyond. 
Give oe ate SVIE groups, the per- 
for th of significant 7’s ranged from 
and XI € single occupational Groups VI 
Pation i -64 and .62 for the multioccu- 
The “ti Groups II and IX, respectively. 
Were i erage 7’s for the interest groups 
Musica est for the Business Detail, 
turin lan, and President of Manufac- 
for Oncern occupations and highest 
Ontaci Physical Science and Business 
the ct fields. The latter areas also had 
The freatest number of significant 7’s. 
ate Wo highest average 7’s in the table 
and th, -52 between Group II and System 
Servio € .42 between Group V and Social 
Werg e, With only a few exceptions, the 
€ 7's seem to be representative of 
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most of the correlations in SVIB groups, 
since the standard deviations for the 
distributions of coefficients within the 
groups were relatively small, as com- 
pared with their possible magnitude, and 
were uniform from group to group. 

Summarizing the r’s in Table 1 by 
reading down the columns, rather than 
across the rows, indicates that some of 
the vocational motivation factors are 
related to more SVIB groups than oth- 
ers. System correlates the most often 
and the highest with the interest groups, 
being significantly related to them in 
8 out of 11 instances. Social Service and 
Behavior Control follow with four sig- 
nificant 7’s for each. In contrast, none 
of the correlations for Material Security 
and the interest groups are significant, 
and only two for Structure are signifi- 
cant (at the .05 level). With respect to 
the nonoccupational scales, Social Serv- 
ice and Behavior Control correlate posi- 
tively with Interest Maturity; Material 
Security and Personal Status relate 
negatively to Occupational Level; and, 
Social Service correlates negatively, 
whereas System is associated positively. 
with Masculinity-Femininity. 

The results from the Type I analyses 
of variance were negative for the com- 
parisons of subjects within the SVIB 
groups which had primary, secondary, 
and reject patterns. Their overall means 
for the vocational motivation variables, 
i.e., across the seven factors, were not 
significantly different in any of the in- 
terest groups. As might be expected 
(McNemar, 1962), however, from the 
significant 7’s yielded by the correla- 
tional analysis, several of the interac- 
tions between SVIB interest patterns 
and motivation factors were highly sig- 
nificant. The interactions occurred in 
the same interest groups which had sig- 
nificant correlations, with one notable 
exception. Whereas none of the 7’s for 
Group VIII (Business Detail) was relia- 
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TABLE 1 


A ES 
Propuct-MoMeEntT CORRELATIONS BETWEEN VOCATIONAL Motivation Factors anp SVIB SCAN 


SVIB 
group 


I. Biological 
Sciences 


II. Physical 
Sciences 


UI and IV. 
Technical 


V. Social 
Welfare 


VI, VII, 
and VIII. 
Business 
Detail 


Mate- Job Per- 
SVIB rial se- free- sonal Social Behavior Shue 
occupation curity dom status service control System ture 
Artist 030 230 —207 —107 —340 072 — 28 
Psychologist —157 270 —080 173 031 o8 =- W 
Architect — 030 270 —167 —251 —275 215 pA 
Physician -13 343 -247 1o —215 351 -1 
Osteopath 035 241 —231 019 —138 252 -i0 
Dentist —016 258 —306 —248 —324 436 Z 003 
Veterinarian 093 027 —188 —100 —186 ay = 120 
Average r —020 240 —210 —090 —210 230 =” 
Mathematician —167 359 —239 —203 —281 387 a 
Physicist —089 400 —245 —288 —286 548 493 
Engineer —014 276 —155 —353 —240 577 016 
Chemist —006 356 —172 —273 —300 56l go 
Average r —070 350 —210 —280 —280 oa 
Production 216 
Manager 053 067  o73 095 08-353 
Farmer 128 120 —047 —412 —280 349 014 
Aviator 131 129 —o0l4 —408 —252 364 ay 
Carpenter 135 169 —042 —298 —231 439 033 
Printer 2110-18034. 271 177 185 
Mathematics and 
Physical Science 129 
Teacher —019 207 —074 —068 —o0ll 332 
Industrial Arts 096 
Teacher 032 188 —155 —238 —160 3853 
Vocational and 
Agricultural 065 
Teacher 022 —001 ~096 —121 —077 152 474 
Policeman 147 —047 84 051 056 163 60 
Forest Service Man 017 075 —oss 200 —046 280 go 
Average r 090 120 —00 -230 —130 290 
YMCA Physical 066 
Director 003 —067 003 357 317 —116 078 
Personnel Director —059 _ 132 182 328 427 —295 
Public 100 
Administrator —166 029 16 asz 4mo —21 gs 
YMCA Secretary —127 101 106 466 413 35 
Social Science | oi! 
Teacher oos —179 173 450 357 41S 
City School 2! 
Superintendent —180 —020 —o02 449 363 —26t o0 
Social Worker =100 —043 106 470 364 307 _o# 
Minister —132 061 = —035 419 248 ep 030 
Average r —100 -—060 080 420 360 —29 124 
Musician 056 100 —os9 128 042, 035 050 
CPA —161 036 050 181 215 =o 1: 
Senior CPA 016-023 ou -i4 mo O20 
Accountant 013 — 046 101 013 cot S 


V=130. 


tthe F (4.88, dj=6/762) for the in- 
eve] ton was significant at the .001 
tion | Further analysis of this interac- 
Oty tien t tests revealed that it arose 
Free, ifferences in the means for the Job 

$ ‘om and Personal Status factors. 
Onda ects who had primary or sec- 
Broy Y patterns in the Business Detail 

UP scored relatively higher on moti- 
na for Personal Status as compared 
a Job Freedom than the subjects who 
The reject patterns in this interest area. 
joey Means for these two groups of sub- 

yon the factors and the £ value for 
at tp efaction, which was significant 
Prim e€ 001 level, were as follows: 
] ary /Secondary—Personal Status = 

Job Freedom= 8.33; Reject— 


Wit 
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a g 7 TABLE 1—Continued 
i , Mate- Job Per- 
BY IB SVIB rial se- free- sonal Social Behavior Struc- 
wea occupation curity dom status service control System ture 
Office Man 159 —200 212 071 224 —230 200 
Purchasing Agent 140 —108 212 —165 023 —049 100 
Banker 033 —321 191 029 218 —211 212 
Mortician 136 —286 148 207 155 —242 149 
Pharmacist 251 —080 086 065 —107 —007 023 
i Average r 100 —150 150 010 120 —100 140 
xX. Business Sales Manager 037 —265 245 239 335 —364 010 
Contact Real Estate 
Salesman 133 —341 290 166 094 —382 008 
Life Insurance 
Salesman 025 —306 179 452 321 — 494 019 
x A ger 060 —310 240 290 250 —400 140 
A. Verbal Advertising Man 010 —082 134 163 068 —493 —188 
Lawyer —047 —088 057 268 153 —398 —162 
ann Author-Journalist 037 099 —062 005 —212 —207 —294 
. Average r 010 —020 040 150 000 —370 —210 
XI President 
of a manu- 
facturing 
n concern —008 053 023 053 O41 169 090 
is occupa- Interest Maturity —148 —039 051 239 296 —219 036 
Onal scales Occupational Level — 18S 059 —225 103 033 —045 —106 
Masculinity- 
RN Femininity — 009 065 —035 —419 —133 382 087 
omitted 7S of .174 and .228 a significant at the .05 and .01 levels, respectively. Decimal points have been 


Personal Status=16.85, Job Freedom= 
10.32; £=3.29. 


Discussion 


Tn general, the results were favorable 
to the hypotheses, indicating that kind 
(but not strength) of vocational motiva- 
tion is related to interests, but there 
were some noteworthy exceptions. Some 
predicted relationships were not ob- 
tained, and some obtained relationships 
were not predicted, as the following dis- 
cussion of the correlations for each 
SVIB group points out: 

Group I (Biological Sciences). Job 
Freedom correlated with interests in this 
group, as hypothesized, but so did Sys- 
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tem to about the same extent. Also, there 
were negative correlations with Personal 
Status and Behavior Control. Appar- 
ently, the individual with interests in 
this group is motivated by a desire for 
autonomy in his work, as expressed in 
being on his own as well as not control- 
ling the activities of others, and by a 
need for an orderly and planful ap- 
proach to his work. It may be that it is 
this motivational complex which ac- 
counts for the high intercorrelations of 
the occupational scales in this group, 
which are otherwise difficult to rational- 
ize. If so, it may make better sense for 
counselors and personnel workers to 
interpret Group I interests in terms of 
common motives rather than job duties 
and tasks, and thus resolve the worri- 
some problem of including Artist and 
Architect in the Biological Sciences. 

Group II (Physical Sciences). The 
predicted relationship of System to in- 
terests in this group was strongly sup- 
ported by an v of .52. As in Group I, 
other correlations were also significant, 
notably the positive relationship with 
Job Freedom and the negative associa- 
tions with Personal Status, Social Serv- 
ice, and Behavior Control. Taken to- 
gether, these relationships seem to 
characterize Physical Science interests 
as they have usually been interpreted: 
a focus upon working with things me- 
thodically and systematically in a rela- 
tively free situation with little emphasis 
upon personal aggrandizement, 

Groups II and IV (Production Man- 
ager—Technical). The hypothesis that 
System would be related to these occu- 
pations was substantiated. In addition, 
Structure was positively related to 
Group III and Social Service was nega- 
tively correlated with Group IV. The 
pattern of 7’s for these two groups is 
similar to that for Group II, with the 
important difference that there is no re- 
lationship with Job Freedom. Since the 


Technical occupations are at a - 
level of responsibility and skill than 5 : 
scientific professions, however, the dil 
ference in motivation for autonomy ™ 
one’s work might be expected. die 

Group V (Social Welfare). Again, n 
predictions were upheld, with Soc z 
Service and Behavior Control oat 
lating with interests in this group. TH ati 
was no differentiation, however, Eene E 
these factors in their relationships oa a 
Administrative and Personal Condon 
occupations. The negative correla, 
with System is explicable; since this ther 
tive relates to working with things "a tel 
than with people. Thus, the usual A Or 
pretation of Group V interests be mo- 
cially oriented is consistent with t dto 
tivational factors which are relate 
them. 

Groups VI, VII and XI ca 
CPA, President), The correlation were 
these single-occupational groupe d did 
generally low and nonsignificant z of the 
not support the predictions. N a 
7’s for Musician was large Laie and 
significant, and those for tation 
President were contrary to expec ut the 
As a result, little can be said os inte!” 
motivations which are related “than 
ests in these occupations other “oe 
note that further study of t” 
needed. il) phe 

Group VIII (Business or in 
hypothesized relationship © 


icia, 


analyses, although the latter 
that there is a motivationa £ petal 


which may be related to Busine - end 
interests. There appears to be ries and 
ency for individuals with prima a mot! 
secondaries in this area to hav? * | this 


vation toward Personal Status, sidere? 
becomes apparent only when igation He 
in conjunction with their ae les? 
Job Freedom, which is rela aal analy 
strong. Because the correlatio 
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Sis dealt with the relationship of only 
a motivational variable to interests at 
sie instead of all factors simultane- 
eel in the Type I design, it did not 
ble al this pattern. It makes considera- 
the Post hoc sense, however, because of 
we nT and status which can be 
võrk rough white-collar, office-type 
Mi IX (Business Contact). Con- 
tar to prediction, interests in this 
thee Were related to practically every 
tial ece ational factor except Mate- 
tions ae There were positive corre- 
Enie with Personal Status, Social 
tive oe and Behavior Control and nega- 
System Ociations with Job Freedom and 
interest all of which suggest that sales 
tional : reflect a complicated motiva- 
well ie consisting of egocentric as 
Bei eee welfare and possibly de- 
Which z needs, The general stereotype 
a Gene of the salesman is that 
Needs oe narcissistic individual who 
ut who ers to enhance his self-image 
goals also strives to achieve social 
G and objectives. 
for oe X (Verbal). The correlations 
explain group are somewhat difficult to 
tatus | Ths hypothesized Personal 
Negative ationship was not obtained, but 
tructur associations with System and 
Correlatio were. Without any positive 
Ctors he for the other motivation 
Ships ig e meaning of these relation- 
n anta not clear, but they may reflect 
Plieq pe ah toward authority, as 1m- 
S let, rebellion against System and 
individ Which is often characteristic 
Nong uals with verbal interests. 
tions CcPational Scales. The correla- 
Beherally ” the nonoccupational scales 
Petar eee With their usual inter- 
tively S ns. Interest Maturity was posi- 
With elated to motivations for working 
Conte roPle (Social Service, Behavior 
tive 01); Occupational Level was nega- 
associated with sources of ex- 


trinsic satisfactions in work (Material 
Security, Personal Status) ; and, Mascu- 
linity-Femininity of interests was posi- 
tively correlated with a nonperson (Sys- 
tem) and negatively related to a person 
(Social Service) orientation. 

The motivation factors which ac- 
counted for the largest amount of varia- 
tion in interests across the 11 SVIB 
groups were the System, Social Service, 
and Behavior Control variables. In com- 
bination, these motives seem to corre- 
spond rather. closely to the “Things 
versus People” bipolar factor identified 
by Thurstone (1931) and Strong (1943) 
in factor analyses of SVIB, which sug- 
gests that this interest-motivation di- 
mension may be the basic one along 
which occupations are differentiated. 
Job Freedom and Personal Status make 
some contribution to individual differ- 
ences in interests, but not as much as 
the other factors. Material Security and 
Structure are essentially unrelated to 
any of the interest groups, which agrees 
with the common interpretation of SVIB 
as a measure of “intrinsic and self-per- 
petuating satisfactions” rather than the 
extrinsic and concomitant rewards of 
work (Darley & Hagenah, 1955, p. 12). 
The studies by Sarbin and Berdie 
(1940) and Kinnane and Suziedelis 
(1962) would generally be consistent 
with these conclusions and increase our 
confidence in them, Theoretically, the 
identification of a person-nonperson ori- 
entation which underlies differential in- 
terest patterning fits Roe’s (1957) hy- 
potheses about the relationships of these 
variables to each other and to parental 
attitudes which may have influenced 
early vocational behavior. The concep- 
tualization of vocational motivation as 
an intervening variable between familial 
conditions and interest development 
would appear to have some promise for 
both explanatory and heuristic purposes. 

Alternative interpretations of the re- 
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sults should be considered, however, 
since it might be argued that the corre- 
lations of the interest and motivation 
measures may reflect only common test 
variance or represent simply covariation 
between two associative tendencies. A 
motivational variable is usually defined 
as having two characteristics: (a) it has 
the associative or cognitive property of 
facilitating the occurrence of specific re- 
sponses, and (b) it acts in a more gen- 
eral way, i.e., to energize indiscrimi- 
nately all of the reaction tendencies in 
a given situation and/or to lead to the 
learning of responses which eliminate 
or reduce its intensity (Farber, 1955; 
Melton, 1950; Shaffer & Shoben, 1956). 
Although very few variables have been 
shown to possess these last two attri- 
butes, they are the critical ones in dis- 
tinguishing a variable as motivational 
(Brown, 1961). It is important to ask, 
therefore, whether the so-called voca- 
tional motivation factors function so as 
to either stimulate a variety of behaviors 
or produce learning. What evidence 
there is on this problem is admittedly 
sketchy and open to many of the criti- 
cisms which have been made of other 
test definitions of motivation (Child, 
1954; Farber, 1955), but it nevertheless 
provides a presumptive basis for infer- 
ring that the instruments used in this 
study have some validity as measures of 
motivational variables. The most rele- 
vant data come from a study by Ham- 
mond (1959) in which she found that 
survivors of a 5-year college engineering 
curriculum had scores on the Occupa- 
tional Attitude Rating Scales which con- 
formed more closely to the faculty’s per- 
ception of the “ideal” student at the end 
of the training program than at the be- 
ginning. In other words, this instrument 
was related to persistence in an activity 
over a long period of time and acquisi- 
tion of responses appropriate to the at- 
tainment of a desired goal, both of which 


are indicative of the operation of a m0- 
tivational variable. Additional research 
is definitely needed, but it appears just- 
fable to conclude tentatively that voca: 
tional motives can be validly assess¢ 
with inventories and questionnaires 2 
that they are systematically related : 
vocational interests in many of the way 
which current theories propose. 
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DIVERGENT CONCEPTS OF TEACHER ROLE: 


AN APPROACH TO THE MEASUREMENT OF TEACHER 
EFFECTIVENESS * 


A. GARTH SORENSON, T. R. HUSEK, axp CONSTANCE YU 


University of California, Los Angeles 


Role theory offers a potentially important approach to the investigation 
of teacher behavior and effectiveness. This paper reports the Ist steps 
in the development of an instrument designed to assess teacher role 
expectations. A preliminary form administered to 284 students was 
designed to measure 6 role dimensions: information giver, disciplinarian, 
advisor, counselor, motivator, and referrer. A factor analysis confirmed 
these 6 factors, and provided a basis for a revised "form which was 
administered to 94 students. These results also were factor analyzed. 
On the basis of the 2 studies, a revised set of keys was developed for 
5 of the 6 scales; advisor and information giver were combined to form 
a single scale. Reliability estimates for the scales range from .77 to .93. 
The scales have low to moderate intercorrelations. 
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> te obstacle to developing valid 
Veness he for predicting teacher effec- 
& ein as been lack of a solution to 
ave neh problem. Investigations 
that an vn with discouraging frequency 
M the Ace observers, whether or not 
disagree ie ag field, are likely to 
Particular harply in the appraisal of a 
reement teacher. The crux of the dis- 

any conce is pinpointed in the fact that 
Nevitab] pt of teacher effectiveness is 
y relative. As Ryans (1960) 
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io n Characteristics of Teachers, 
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effect} Y important reasons why effective and 


Vi in 

y; nasara hers cannot be described with 
K Chere are the wide variation in the 
Pa e i underlying descriptions of de- 
A teacher ing objectives and the differences 
È difer? at different educational levels, 
b. 371), subjects and with different pupils 
te If tw 
Sood t 
n Min, 
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0 indivi ‘4 i 
à individuals, in speaking of the 
d et are in fact likely to have 
ifferent traits because they ex- 
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Precint nors would ‘like to express their 
ty Ater, m to the Western Data Processing 
tet e ie Sa of California, Los Angeles, 
fop tte in of facilities in processing the data 
Supery; this study and to Shirley Schaefer 
Ising the analysis of data. 
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pect him to perform different functions, 
then they are also likely to disagree 
when asked to judge a particular teacher 
because he may satisfy the expectations 
of the one but not the other. It is erro- 
neous to assume that terms like “good 
teacher” or “effective teacher” have a 
common meaning. It is impossible to 
talk about teacher effectiveness except 
within a particular system of values and 
a set of expectations based on those 
values. The first step in predicting 
teacher effectiveness, therefore, should 
be the development of a measure to 
identify and study different expecta- 
tions. This paper presents the initial 
stages in a research program designed 
to examine the nature and influence of 
teacher role expectations. 

The concept of role expectation as 
used in this approach is similar to Sar- 
bin’s (1954). A society may be re- 
garded as structured into a number of 
positions, statuses, or offices. Each of 
the positions, designated by a single 
term, such as father, policeman, or 
teacher, is a collection of rights and 
duties. The actions of the individual 
are organized around these positions and 
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comprise the role. The role is linked 
with a position and not with the person 
who occupies the position. To the ex- 
tent that the actions of a person in a 
particular position are perceived as con- 
forming to the expectations (prefer- 
ences) of the members of his society, 
he may be said to be successful in ful- 
filling that role. To the extent that he 
fails to behave in the prescribed man- 
ner, that he does not conform to the role 
expectations, he is subject to censure. 

In our society there is no universal set 
of expectations which defines a teacher’s 
role. Instead, an unknown number of 
sets is held by people from varying cul- 
tural and socioeconomic backgrounds, 
each individual being further differen- 
tiated by his particular experience and 
specific relationship to the teaching pro- 
fession. In order to predict how a par- 
ticular observer will judge a teacher, it 
is necessary first to discover what the 
observer’s expectations are with respect 
to the teacher’s role. It is essential to 
determine the criteria he employs in 
judging and the actions or qualities per- 
tinent to the formation of his opinion of 
a teacher, 

Knowledge of the individual’s role 
expectations cannot be obtained by the 
simple expedient of asking him about 
his criteria, as he is probably unaware 
of some of the most crucial factors. He 
is unable to state precisely the deter- 
minants of his judgment. If he is 
asked about the basis for his judgment 
of teachers, what he is likely to report 
is a series of abstractions—intelligent, 
friendly, and efficient—abstractions for 
which there are no easily applied be- 
havioral definitions. As indicated by 
Sarbin (1954), role expectations are 
cognitive and must be inferred either 
from phenomenological report or from 
the analysis of other kinds of data, 

Described below is an instrument from 
which it is hoped inferences can be 


made regarding teacher role expecta- 
tions, specifically with regard to Dt 
personal relations. Among the hypo 5 
ses which might be tested with such a! 
instrument are the following: 


re 

1. When teachers and aor 

paired according to role a pe 
greater satisfaction will be expe"! 


be predicted by discovering 
expectations of the teacher an 
students. i 
3. The teaching behavior of & ons 
or teacher candidate may be prec! 
from his role expectations. ean ie 
4. If the role expectations © opti 
dividual are judged to be inaph iy, 
ate, they may be changed ae only 
though in some instances proba Y oles 
with considerable difficulty, si7° 
are learned. 


å ilizel 

The several role dimensions wa 
in the first form of the anen ner 
were developed in the following is. 
In discussions with teachers, 90 cher 
trators, and others interested Í 
training, each individual was 
think of one of the best te eats 
knew and also one of the POOF” nces 
then to describe the essential di i ately 
between the two. After appro 3 ade 
2 dozen such interviews, the eae A 
during the interviews were rev! riž H 
an attempt was made to categ t 


rs 
ach and 


descriptive statements, each a W 
represent a role dimension: -~ icjes r é 
stage of the research, various nd t ach! A 
lating to teaching behavior 2°" | a 
evaluation were examine me e a 
for ideas which would be TE role p 
further clarifying the emee o 7) Me 


mensions. A paper'by Seat her 

especially helpful. Six te% 

were postulated, as follows: pah” 
1. Advisor. In this role e gwled” 

uses his own experience 40 
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= recommend strongly a particular 
= tse of action for the student; he 
ves the problem and decides for the 
student, 
N The teacher who as- 
ivin h is role seeks basic causes under- 
tale | behavior; concerns himself pri- 
el with the student, heips him 
t bas fae courses of action on which 
is na is decision; wants the student 
; ink independently. 
beans E This teacher ad- 
sna fad rigidly to rules, authority, 
teiti ition and believes in punish- 
4.1 al incentive. 
eather ormation giver. In this role the 
in Daa a information, but does not 
gards p prova] or disapproval; he re- 
main indie E of learning as his 
A a rata, The teacher manipu- 
e stimul wg so that the student will 
the wists ot to action predetermined 
t real ane er; he uses rewards, implied 
R Incentives, 
instead ere In some circumstances, 
Problem hi dealing directly with the 
help of imself, the teacher secures the 
Counselor Various agencies available: 
0 on: hy Principal, special classes, and 
the PN shifts the responsibility and 
em to others. 


In t 
Min course of performing his duties, 
teacher ng on the circumstances, any 
aboy | Probably will assume all of the 


SNR P s 
will oles at one time or another; he 


late 


shi d è 
ise eee from information giver to 


i r: 
Nevertheless to advisor and so on. 
Ndividuer > it is hypothesized that 
tendep al teachers will differ in their 
t tenes to take one or more roles in 
oy encies to the others and that these 
pi ‘Se are relatively stable charac- 
Db Othes of the individual. If these 
°Ssible es are sound, then it should be 
Whig b to construct an instrument 
“mo g y allowing a subject to select 

Possible role behaviors, will pro- 


vide a picture of the pattern of his 
tendencies and also make it possible to 
predict his future behavior. 


QUESTIONNAIRE 


The Teacher Practices Questionnaire 
(TPQ) consists of 30 problem situations 
typical of those encountered by teachers 
in their daily routine. Each problem 
situation is a brief description of a 
student and his behavior. For example: 
Jerry, IQ of 149, enrolls in as many “snap” 
courses as possible in high school, and receives 
B’s and C’s with little effort. He tells his 
schoolmates, “Get wise. Don’t kill yourself 
with homework. The school will have to 
graduate you when you are of age anyway.” 


In constructing the problem situations, 
an attempt was made to provide simple 
and realistic descriptions and to avoid 
as much as possible the use of value- 
Jaden words which might influence the 
respondent's behavior. The object was 
to give the respondents the opportunity 
to react to the problem situation per se 
and not to be biased by emotional 
terms. 

For each problem, four alternative 
solutions were presented representing 
different role dimensions. Each of the 
possible 15 different combinations of 
roles was presented twice, each of the 
six roles being represented 20 times in 
the instrument. 

For the example given above, the 
following alternatives were presented: 


1. Give him a good “talking to.” 

2. Investigate the possibility of an 
emotional block. 

3. Refer him to the school psycholo- 
gist. 

4. Tell him that he 
wiser use of his native a 
his classmates accordingly. 


should make 
bility and lead 


The subjects were instructed to rate 
each of the alternative courses of action 
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on a 5-step scale as to the degree of 
appropriateness: 


Very appropriate 
Fairly appropriate 
Acceptable 

Fairly inappropriate 
. Very inappropriate 


aAPPwne 


Each alternative was to be scored 1, 2, 
3, 4, or 5, depending on the choice of 
the respondent, and thus there was a 
possible range of scores from 20 to 100 
for each role dimension. 


Stupy 1 
Subjects 


The subjects for Study 1 were 284 students 
in the School of Education at the University 
of California, Los Angeles, working for teach- 
ing credentials. One hundred and twenty-cight 
were candidates for the elementary credential, 
and 156 were candidates for the secondary cre- 
dential; there were 64 men and 224 women. 
These students were divided into the follow- 
ing subsamples: (a) 64 beginning secondary 
credential candidates, men; (b) 94 beginning 
secondary credential candidates, women; (c) 
126 beginning elementary candidates, women. 
All of these subjects completed the question- 
naire during the fall semester of 1961, their 
first semester in the School of Education, 
Approximately 40% of the students 


were 
juniors, 40% seniors, and 20% graduate 
students. 
Results? 


For each subsample, split-half relia- 
bility estimates were obtained for each 


2 Many of the results presented and dis- 
cussed in this paper would be more meaningful 
if more data were presented. However, space 
limitations prohibit this. Consequently a 16- 
page document containing a complete copy 
of the revised form of the questionnaire, a 
listing of the original scales, and the five re- 
ised scales, and for each of the 120 items in 
Por 2, means, standard deviations, and load- 
Pane "the six rotated factors obtained from 
aye sa have been deposited with the American 
a ntation Institute. Order Document No. 
a O ADI Auxiliary Publications Project, 
cot ein Service, Library of Congress, 


of the role dimensions as well as m 
correlations between the roles. L 
split-half reliabilities ranged peren 
.75 and .92. The intercorrelations 

scales ranged between —.18 and ts 
with most of the correlation waite ie 
between 30 and .50. The arn oe 
were deemed adequate for a eae 
form of an instrument, but the 10 i 
correlations between the scales were 


x ide 
too high. Consequently T e it 
to perform a factor analysis an ja on 


the results of the factor analys 
theory underlying the instrument sub- 
vise the questionnaire. The three atl 
samples were combined into one 8} 
for factor analysis. 

A principal-components oe 
performed on the data from’ : 
items and three separate ratation” i- 
also performed. Kaiser’s og 
terion was used for rotations © sht 
spaces defined by the four, six, t 
largest factors. Three separate P rota 
were computed because analy # 
tions are somewhat sensitive ne 
number of factors that are rotate otat d 
results when six factors were © 
were the most reasonable, ie A 
results were used to assist 1n = the 
sion of the instrument. Five 
factors were interpreted as Te 
five of the role dimensions. ë 
vator scale, however, did not iq ctor 
be reflected clearly in any sins! five role 
In addition, although the other ate of 
dimensions were clearly deliné avin’ 
embodied in the analysis, each i idua! 
its own factor, many of the = ctot 
items did not load highly on t 
that we would have predicted: ad 10 pe 

At this point, a decision - ems n 
made whether to relocate the is, whic 
the basis of the factor analys!* 


to re- 


sis was 
ye 120 


nce 
it in dM" 
Washington, D. C. 20540. ee photocoh g- 
$1.75 for microfilm or $2.50 for Pi ph 
and make checks payable rr Congres 
duplication Service, Library ° 
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would have resulted in a questionnaire 
oon situation having more than one 
Ta scored on a single role dimension, 
y to rewrite the items and try to change 
eir factorial composition. 
i one to rewrite the items and 
tha ie “e obtain six role dimensions of 
ia originally postulated. Of the 
Gere Jl were rewritten for the 
version of the questionnaire. 


Strupy 2 
Subjects 


oe for Study 2 were 94 students in 
alifornia ar Education at the University of 
Ondary tea Re Angeles, working for the sec- 
34 os ing credentials. Sixty were women 
rolled in sre men, _ These students were en- 
required k course in educational psychology 
Students į teacher candidates. Most of the 
in this sample were graduates and 


about 
experia had 1 or more years of teaching 


Results: 


Tai Standard deviations, and in- 
revised Pie of the 120 items in the 
intercorrelatt were computed. The item 
Ptintinal fone were subjected to a 
Just as į actor component analysis and, 
tions he Study 1, three different rota- 
varias ot performed using Kaiser’s 
€ patt criterion. This time, however, 
led us t i of the unrotated factors 
factors, © rotate four, six, and nine 
u "es With the first study, the rotation 
ab] 8 six factors was the most reason- 
qui Š he patterns of the loadings were 
taine Consistent with the results ob- 
factors for Study 1, and four of the 
flectin, ould be clearly identified as re- 
matiya the disciptinarian, counselor, 
The sa and referrer role dimensions. 
Biver ee dimensions called advice 
“lane information giver seemed to 


© results of the factor analyses for 


Study 1 and for Study 2, along with 
considerations arising out of the theory 
underlying the instrument, were used to 
generate five revised keys for the five 
dimensions of disciplinarian, counselor, 
motivator, referrer, and advice-informa- 
tion giver (see Table 1). 

The criteria used were as follows: If 
an item had been revised for Form 2, 
then the size of the loading of the item 
on a factor from the second study (and 
to some extent the size of the loadings 
on the other factors), together with our 
judgment as to the appropriateness of 
the item for the factor in terms of the 
underlying theory for the test, were 
used in evaluating and locating the item 
on a scale. If an item had not been 
revised, then we used both factor analy- 
ses and the theory in our revision, Al- 
though our manner of using the factor 
analytic results was not always the same 
from item to item, in virtually no case 
was an item placed on a key on which 
its loading was less than .40. Since we 
could not always find 20 items for a 
particular key, some of the revised 
scales have less than 20 items. It should 
also be mentioned that, although we 
selected items for the keys which pos- 
sessed large loading on the appropriate 
factors and low loading on the other 
factors, we made no attempt to obtain 
keys which would provide uncorrelated 
estimates of the factors. The matter of 
relationships among the various scales 
will be explicated in the discussion. 
Means, standard deviations, and split- 
half reliability estimates for these new 
scales were obtained and are presented 
in Table 2. 

The intercorrelations between these 
new scales were also obtained (see 
Table 3). It should be noted that the 
intercorrelations have been obtained 
from data which were used in part to 
obtain these scales. These correlations 


must be interpreted with some caution, 
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TABLE 1 
2 
EXAMPLES OF PROBLEMS AND ITEMS FOR THE REVISED ScALES oF TPQ, ForM 
Problem Item = 
aa ae “ah g i ou! 
III. A sophomore student in engineering is 9. Provide him with intor oeann aie 
: uncertain about his vocation. He pay scales, opportunities san ann 
comes to you, a professor of en- ment and advancement in bo 
ineering, for advice. He likes his fessions. , d for 
coe tad is making good grades. 10. Tell him that there is ag e ‘Age, 
He believes that it will be financially good engineers in this Hie angle 
profitable to be an engineer; however, that he will find a caree Isori 
he is also strongly interested in Eng- neering most challenging an 
lish. He is altruistic and wonders while. g e the 
whether he can perform a greater 11. Attempt to help him oe 
service in the field of English. causes underlying the unce DE 
" r 0 
IX. During the past few weeks, the fourth 33. Explain to Mary we, m losing 
graders have complained about los- students are annoyed abo 
ing pencils and erasers. Mary is dis- their possessions. her behav- 
covered to be the culprit. She comes 34. Tell her parents ae vith the 
from a middle class family and is ior, and let them dea 
provided with more spending money problem as they see fit. ill be sus- 
than the average student. 35. Warn Mary that she w r 
pended the next time she s$! sail 
5 ; iani ion abo 
XIII. Michael is 13. His parents, itinerant 50. Give him specific intona ed to 
farm laborers, have been forced by how his school work is 
the juvenile authorities to keep him life outside of school. | ments de- 
in school. He seems to be placed 51. Give him special cng noe 
properly in terms of ability; but when signed to capture his in 
assignments are given, Michael is 
often heard to complain, “Not that 
again!” He will also lay his head on 
the table although he does get enough 
sleep. It is not uncommon to find 
“doodling” on his papers and other 
signs of boredom, pout 
i a 
XIV. Jane has marked her table with cray- 53. Try to explore her feelings 
ons several times. Each time she was the school situation. rivileges 
reprimanded and asked to erase the 54. Take away all linsang iae the 
marks. Today she has put pencil from Jane and ask her i as other 
marks in a library book. marks in her book as we! 
library books. r be- 
56. Tell Jane’s parents about be to 
havior—leave it up to feel iS 
take whatever action they 
appropriate. PE side 
ý j 
XXIII. The class is very excited about a pro- 89. Urge her to look at the brig 


posed field trip. Jackie listens quietly 
to the hubbub and then says, “I hope 
it will not rain that day.” At a sur- 
prise birthday party given her by the 
class, she whispers to Nancy, “This 
is so nice. I am afraid to enjoy it too 
much. Besides, it will all be over 
so soon.” She often appears sad. 


of life. se ate more 
Arrange for her to participats ž 
frequently in those activ! i 


90. 


91. Get better acquainted W 


sa 
discover and plan more i 
experiences. iar to accep! 
92. Ask the school paani eases 
the responsibility for tht 


Scale 


M 


Al 


M 


AI 


M 
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TABLE 2 


M 
Means, Sranparp DEVIATIONS, AND RELH- 
BILITY ESTIMATES FOR THE REVISED 
Scares or TPQ, Fors 2 


` Split- 
half? 
Number reliabili- 
of items ties pro- 
s per jected to 
cale scale M SD 20items 
gë tiplinarian 18 689 14.69 86 
or 19 37.0 12.89 93 
ofan 10 22.6 6.31 80 
É 10 35.4 T k 
dvice-informa- 5 7.37 86 
ion giver 15 370 838 -77 


‘S 
pearman-Brown prophecy formula. 


pre some indication of the inter- 
tee oe of the scales. The reliabili- 
w ich ince they are computed for data 
Scales were used in part to select the 
au T be interpreted with extreme 
as up . They can, however, be treated 
The va bounds for the reliabilities. 
the on lability estimates generated for 
ata — role dimensions from the 
për == Study 1 suggest that these 
r estimates for Study 2 are 
Point incl iased, Evidence for this last 
items on udes the fact that most of the 
the dim the revised scales are scored on 
Resting To predicted for them, sug- 
at the actual reliabilities for 


San 
evised scales are probably not too 


TABLE 3 


NTE 

RC 

ORRELATIONS FOR THE ReEvISED SCALES 
or TPQ, Form 2 


Advice- 

infor- 

Scale Coun- Moti- mation 

D selor vator Referrer giver 
Coy Plinarian 16 2k 50 42 
Motive ct 40 06 19 


ti 
Repgyator 33 38 


different from the reliability estimates 
in Study 1. 


DISCUSSION 


The results of the study indicate that 
it is feasible to conceptualize and 
measure teacher role expectations in the 
manner described above. The split-half 
reliabilities of the scales are deemed 
adequate. The results of the two item 
analyses, while resulting in some modi- 
fication of the original dimensions, tend 
to support the concept that role dimen- 
sions “exist.” Subjects who were selected 
at random from each of the subsamples 
consistently reported that the problem 
situations and the alternatives presented 
were realistic and meaningful to them. 

The five revised scales have low to 
moderate intercorrelations. In selecting 
the items for these scales an attempt 
was made to obtain items as pure as 
possible, but we did not deliberately 
attempt to develop unrelated scales. We 
do not believe that the dimensions we 
are studying are necessarily unrelated 
in the behavior of people and we do not 
feel that it is necessary to force inde- 
pendence in the scales, In fact, the 
existence and nature of the relationships 
are themselves an area of study. 

However, the fact of the relationships 
leads to another point. Since the scales 
are related, it is possible that fewer than 
five clear scales would be sufficient to 
treat the variance produced on the in- 
strument. Our data and experience in 
working with the instrument do not 
point in that direction. They do lead, 
very definitely, to the conclusion that at 
this time the five revised scales as pre- 
sented in this paper provide a reason- 
able framework for treating teacher role 
expectations. 

Of course, the theory underlying the 
test and the test itself both require 
further investigation, but the results re- 
ported here are interpreted as indicating 
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that the approaches which were em- 
ployed are promising and that further 
research is warranted. At the present 
time, studies concerned with the follow- 
ing matters are in progress or under 
consideration: Continued work on re- 
finement and clarification of the scales 
is necessary, including examination of 
the relationships between dimensions. 
More needs to be known about the de- 
terminants of teacher role expectations, 
the stability of teacher role expecta- 
tions, and the conditions under which 
changes occur. We are planning to in- 
vestigate the relationships between 
teacher role expectations and other per- 
sonality variables. We want to know 
more about the relationship between an 
individual’s teacher role expectations 
and the kind of judgments he will make 
of a teacher with known characteristics. 
Perhaps most important, we want to 
know more about the relationship be- 
tween a teacher’s concept of the teach- 


A. G. Sorenson, T. R. Husex, anp C. Yu 


ing role and his performance, as it iS 
observed by others. F 

A set of procedures which will permit 
the prediction of teacher effectiveness, 
not in terms of a set of absolute charac- 
teristics, but in terms of the traits fe- 
garded as significant by judges of differ 
ing educational philosophies, dirfering 
personal preferences, and in differing 
situations would have obvious value. + 
seems possible that this study consti- 
tutes a significant step in that direction: 
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TRAINING FIRST-GRADE CHILDREN IN CREATIVE 


THINKING UNDER 
QUALITATIVE 


CONNIE J. CARTLEDGE 
Emory 


QUANTITATIVE AND 
MOTIVATION * 


AND EDWIN L. KRAUSER 
University 


In an experiment designed to stimulate creativity in 1st-grade children, 
120 Ss who scored the lowest on a screening test of creativity were 
divided into experimental and control groups. Experimental Ss had 
5 20-min. training sessions in how to improve toys by using Osborn’s 
principles for developing new ideas. 1% of the experimental and control 
groups were motivated for number of suggestions, the other half for 
quality. The hypothesis of difference between traintd and nontrained 
Ss was supported (p < .01) but not the hypothesis of difference between 
Ss motivated for quantity and quality of response. 


eo present experimental study is 
à ncerned with the feasibility of encour- 
one creative thinking in first-grade 
eee It is designed to test the find- 
See of E, P. Torrance’s (1961) study 

Creativity in elementary school chil- 
be In his experiment Torrance manip- 
tent the following variables: (a) 
a ning in principles for developing 

fative ideas, (b) motivation for 
i and quality of creativity, and 
he competition among subjects. He 

Ncluded his study with the following 
Statement: 
hap ept in 
ideas 
Clever, 


the first grade, children who have 
the benefit of training produced more 
and showed more flexibility and more 
Ness in their thinking than the children 
ad no training. . . . The results provide 
Pport for motivating pupils in the pri- 
i Brades to produce a quantity of ideas 
Out consideration for quality [p. 41]. 


a problems dealt with in the pres- 
; + experiment arise from these conclud- 
chila Statements, ie, for first-grade 
see ten, training had no effect, and dif- 

Nees due to motivation for quantity 


© sy 
Mary 


1 
Carpised on a thesis submitted by Connie J. 
ate ledge (1962) to the faculty of the Gradu- 
fuli chool of Emory University in partial 
of n Pent of the requirements for the degree 


aster of Arts. 


versus quality were inconsistent. There- 
fore, three null hypotheses were formu- 
lated. 

Hypothesis 1: 


M experimenta ~ Mcontroi = 0 


There will be no reliable difference be- 
tween the scores of the children in an 
experimental group on a test following a 
5-day training period and those of an 
untrained control group. 
Hypothesis 2: 
Mo(quantity) — Mo (quality) =0 
Hypothesis 3: 

My (quantity) — Mp (quality) =0 
There will be no reliable difference in 
the Originality (O) or Flexibility (F) 
scores of Group A and Group B if, dur- 
ing training, all responses of Group A 
subjects are reinforced, and only the 
novel and original responses of Group B 
subjects are reinforced. 


METHOD 


Subjects 


The subjects were 120 first-grade children 
selected on the basis of their low creativity 
scores from a larger sample of 187 children 
in two elementary schools. 
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Procedure 


The procedure consisted of five principal 
steps: (a) administration and scoring of the 
initial screening test, (b) division into experi- 
mental groups, (c) administration and scoring 
of the initial pretests, (d) training under 
quantitative and qualitative motivation, and 
(e) administration and scoring of the indi- 

idual posttests. 
eo T mitial Screening Test. A nonverbal 
group test of creativity developed by Tor- 
rance and the staff of the University of Min- 
nesota’s Bureau of Educational Research was 
used in the present study. The first two tasks 
of Torrance’s Non-Verbal Creative Thinking 
Tasks, Form NVA, were used as a composite 
to form the initial screening test. These tasks, 
entitled Picture Completion and Figure Com- 
pletion, were administered and scored accord- 
ing to the instructions in the revised test 
manual (Yamamoto, 1962). The interjudge 
reliability coefficients computed from the first 

50 tests for the scores Elaboration, Activity, 
and Flexibility range from .69 to 84, This 
was done by computing xs and converting 
them into contingency coefficients, 

Division into Experimental Groups. The 
128 subjects from two schools who scored 
the lowest on the three score distributions 
were assigned to the experimental and control 
groups such that each group was representa- 
tive of the total sample. Before the next 
division of groups, 11 subjects dropped out 
and 3 were replaced. Then, the 60 left in the 
experimental group and the 60 left in the con- 
trol group were further divided so that one half 
of the experimental group was trained under 
quantitative motivation (Group A), the other 
half under qualitative motivation (Group B); 
one half of the untrained control group was 
tested under quantitative motivation (Group 
C), and the other half of the controls was 
tested under qualitative motivation (Group D). 
One half of each of the four groups partici- 
pating in the experiment was from School X; 
the other half was from School Y. 

The Individual Pretest. Each subject was 
given Task V, the Product Improvement 
Test (PIT), from the verbal “How Good Is 
Your Imagination Test Series,” Revised Form 
C (Torrance & Michie, 1959). The three scores 
which this test yields, and whose Pearson r 
interjudge reliability coefficients range from 
78 to .93, are Ideational Fluency, Flexibility, 
and Originality. Creativity was again defined 
as a composite of these scores and, except for 
minor changes, the scores were obtained ac- 
cording to the scoring manual. Fluency was 
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the total number of responses given; Hee 
bility was the number of “runs” or a 
in ideas in terms of the Osborn (1957) PH 
ciples; and Originality was the sum 0 A 
scores weighted for their inverse frequ 
within the present sample. The criteria 
these Originality score weights were: 2 os 
frequency > 6%; 2, if 6% > frequency 
4%; and.3, if frequency < 4%. e for 
The testing procedure was the sam that 
each subject, with the one exc eo 
Groups A and C were given different ais in 
tions than Groups B and D. The Sr y d 
Groups A and C, motivated for „auan tions: 
response, were given the following instr 


ncy 
for 


I would like for you to see A jittle 
ideas you can think of to improve t £ more 
toy dog so boys and girls will ten them 
fun playing with it. I'll try to Wr to me 
down just as fast as you tell tira of, it 
Tell me every idea you can thin w crazy 
doesn’t matter how good it is or eA it 
it sounds. Don’t worry about how ; 

would cost. vated {0° 
Subjects in Groups B and D, mot llowiné 


i e 
quality of response, were given th 
instructions: 


I would like for you to see 
ing, clever, and unusual ideas 
of to improve this little toy 
and girls will have more fun Pp fee ast, s 
T'll try to write them down Jus S xciting 
you tell them to me. Think of out how 
ideas as you can. Don’t worry 3 
much it would cost. 


i 
what inter 
you can 
dog SO ft: 
laying w 


me 
pall? 
ve and Qualia pye 


Training under Quantitati iven i of 


Motivation. Groups A and B Wero ite a 
20-minute training sessions which speri en za 
the following procedures. The os i ict 
put a list of the subjects’ names boa? i Ti 
of the toy to be used on the blac «ons 


i es ed 
subjects’ tasks were to make ge a5 | S 
how to improve the toy whl ia manip" ed. 


around so that each child cou er accep by 
and examine it. The experimen a check j 
modified the drawing, and pv eboard oF ys 
the subject’s name on the ha chec. Tpos 
suggestions from Group A. Group “pild 
were given to the subjects in j the not 
suggestions were not accepted, a 
was told why, ie. his alee ch 
very unusual or different. On jmente 

under the blackboard the on with 5 © he 


a chart of the subjects’ is g days ° gh? 
squares corresponding to t! Fs the names: most 
training week to the right of ©". g 


subject in each group who Te 
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check marks pasted a blue star by his name 
on the group chart at the end of the training 
Session. The experimenter told the children 
at the beginning of the week that the one who 
had the most blue stars at the end of the 
contest” would receive a prize. 
2 The expérimenter taught the subjects to 
improve the toys by means of the Osborn 
Principles. The following principles were pre- 
Sented on Monday: magnification, addition, 
Subtraction, and multiplication. The next five 
were presented on Tuesday and they were: 
division, substitution, combination, change 
valor, and change position. During the Wednes- 
ne, session the remaining principles were 
ee reversal, sensory appeal (motion, 
k nd, light, and odor), change shape, and 
Ha the quality of the material. Thurs- 
vies and Friday’s sessions were spent in re- 
‘ing all the principles and using them to 
Modify the toys. 
ee Square cards were used to teach the 
aS the Osborn principles. However, in 
in ion to the 12 card principles used by 
esa (1961), five other cards were intro- 
t S A These were: a round card to represent 
fount eee of changing shape; an aluminum 
a pi to represent changing the material; and 
EG of a light bulb, bell, and flower to 
a esent changing the toy by giving it eye, 
Sitar smell appeal, respectively. A plain 
nee was shown first, then each of the other 
é chia held up as the experimenter asked 
sate ildren “What have I done to the white 
tees; now?” The principle that the card 
a esented was then related to the suggestions 
were n lecte had given previously and they 
urth urged to use the principles in making 
win S suggestions about the toy in order to 
Sessi e check marks. The toys used in the 
oy ons were the following, respectively: a 
n a mechanical cat, a toy Nurse’s or 
call Or’s kit (depending on what the children 
= it), a stuffed monkey, and a wire puzzle. 
he Individual Posttest. After training, PIT 
again administered to each subject indi- 


Vidually, 


T 
"eatment of the Data for PIT 


ool Scores were transformed to difference 
Posts by subtracting the pretest from the 
in all and these difference scores were used 
b Statistical analyses. Three 2 X 2 X 2 mixed 
Sa factorial designs (Edwards, 1960) were 
Stop ted to analyze the data of the three 
=e Fluency, Flexibility, and Originality. 


RESULTS AND DISCUSSION 


The means and standard error of the 
means of the difference scores on PIT 
are shown in Table 1, and the results 
of the analysis of variance for the train- 
ing, motivation, and schools factors are 
shown in Table 2. 

In order to increase the power of the 
F tests some of the interaction variances 
have been pooled with the within-group 
variance according to a multistage 
decision rule (Winer, 1962). When 
pooling, care ‘must be taken to avoid a 
Type II error, that is, accepting a hy- 
pothesis of zero interaction when it 
should be rejected. Accordingly alpha 
was set at the .25 level when the pre- 
liminary tests on the interaction mean 
squares were made. The results of these 
preliminary tests indicated that the 
mean squares of only the Motivation x 
Schools interaction on the tests for 
Fluency and Originality are significant 
at this alpha level. Hence the Motiva- 
tion X Schools sum of squares was not 
pooled with the Training X Schools, 
Training x Motivation x Schools, and 
within-group sum of squares for Flu- 
ency and Originality. On the test 
for Flexibility, however, the Motivation 
x Schools interaction was pooled with 
these others. The Training x Motiva- 
tion interaction variances were not 
pooled because training and motivation 
are fixed factors and, as such, cannot 
form the denominators of the F ratios. 

Hypothesis 1 was tested by the train- 
ing factor mean square which corre- 
sponded to the effects of training versus 
no training averaged over the two levels 
of motivation and of schools. Table 2 
shows that using pooled variances as 
denominators all three F ratios are sig- 
nificant (p < .01). Training results in 
a superior average creativity score com- 
pared with no training for first-grade 
children. 

The motivation mean square corre- 
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a 
TABLE 2 ¿ce F RATIOS 
la | a = A FINAL ST: Flexi- nality 
Pal | n o wh Source + 2.55** D ° 
Z| |sl5 p” 10.00" 1.00 < ot 
Q E= 2 A ing (A) 1 00 es $ . 
Z a Frain cs (By €L ‘es 567 1.00 
A = ; ee Totivation 7.79% < 
= | | z is | & ~ m Mot Sy < 1.00 2.02 
ZEEE | Schools (Z < 1.00 
| -5 à 4 
rs | S PA n A O AXB ae 
= lhe =F BxC 
zZ || 3 Sigos Í = 
T) | = a After pooling: ra 
= || A. on? <0 een quan f- 
AE soz ison betw ion ave 
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less of the type of motivation and (d) 
the effect of differential motivation is 
independent of school regardless of the 
Significant difference between schools. 
This study suggests that with suf- 
cient training sessions even first-grade 
children can benefit from training in 
Teativity, and the results suggest some 
further experiments. It would, however, 
e desirable to determine the role of 
Particular experimenters in producing 
Such gains, as well as the relative 
Permanence of the changes produced. 
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TRANSFER OF ORIGINALITY TRAINING 
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In a study of transfer of originality training, 6th-grade boys were 


. os i le eas 
trained to state unusual uses for a series of familiar objects in “brain 


storming groups.” Ss who received training gave significantly ea 
novel responses to familiar objects not included in training than ronte 
Ss. However, the training groups failed to give more solutions to insig! 
problems involving familiar objects than the control group. 


sc 


Guilford (1950) and co-workers 
(Wilson, Guilford, & Christensen, 1953) 
have suggested that frequency of un- 
common responses is an indication of 
originality and that originality thus in- 
terpreted may be related to ability to 
solve “insight” problems. Maltzman, 
Brooks, Bogartz, and Summers (1958) 
presented subjects with lists of uncom- 
mon uses for objects later presented 
with the two-string problem. They 
found that exposure to uncommon re- 
sponses facilitated performance on the 
two-string problem for women, however, 
the effect of training was not significant 
for men. Flavell, Cooper, and Loiselle 
(1958) found that groups that were 
shown one, two, three, four, or five 
novel uses for a microswitch showed 
progressively superior performance on a 
version of the two-string problem, in 
which the microswitch had to be used as 
a pendulum bob, 

Neither Maltzman et al. nor Flavell 
et al. presented training to improve sub- 
jects’ originality. Indeed, in each study, 
care was taken that none of the uncom- 
mon responses to which subjects were 
exposed was relevant to solving the in- 
sight problem. In neither study could 
the treatment be regarded as increasing 
the repertoire of relevant uncommon 
responses but rather as Providing cues 
that elicited responses low in the exist- 
ing response hierarchy. 

In a pilot study (Anderson, 1961) the 
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ect’s rep- 
were 
tate 


effects of increasing the subj 
ertoire of uncommon repon 4 
explored. Subjects were trained iar ob- 
unusual uses for a series of farm sal i 
jects during “brain-storming N = 8) 
The brain-storming group (N 7) 
showed significantly more p 
originality of response to four than 
objects not included in training 
no-treatment control group ( 
The training group also SES ite 
nificantly greater (p < .01) a i 
solutions to an insight prob familia! 
vented by the authors, in which al ways 
objects had to be used in ca to the 
but failed to show more solution control 
two-string problem than the 
group. : s pape! 
The study described in oe i 
examined further the effects x unco” 
ing the subject’s repertoire pae din 
mon responses. Subjects were t A ual 
brain-storming sessions to state jiar 0% 
uses for each of a series of part firsts 
jects. As a result it was expec uncon” 
that subjects would give m dut” 
mon responses to objects not sects nd, 
ing training than control sub) receiv? 
second, that subjects who perform 
training would show improve involv” 
ance on insight problems fs, 
unusual uses of familiar ohe e a 
The experiment also ape variety’ 
lationship between amount a i ae 
training and transfer. Previo™ mb! 
has shown that the larger 


familia? 


= 


ig- 
d a 8, 
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of different examples of each concept 
encountered during training (Callantine 
& Warren, 1955), the greater the num- 
ber of shifts from concept to concept 
during training (Semne & Warren, 
1955), or the greater the number 
of tasks employed during training 
(Duncan, 1958), the greater the trans- 
ni training. Amount of variety in 
ne is likely to be an especially 
oo variable in studies, like the 
Sent one, that are concerned with 
8eneralized rather than specific transfer 
of training, 


PROCEDURE 


na te sixth-grade boys were randomly 
varian, to one of three groups. Analysis of 
Pirai šhowed that the IQ means, reading 
ment ement means, and arithmetic achieve- 
signifi means of the three groups were not 
icantly different. 

dere were trained. The control group 
met in no treatment. Experimental subjects 
for 19 groups of three with the experimenter 
session po-mninuts training sessions. At each 
erent ve subjects were shown three dif- 
to “n objects, one at a time. Instructions were 
or eae as many original uses as you can” 
two Gan object. The experimenter played 
rected i during the sessions. First he di- 
attributes subject’s attention to the physical 
to alloy es of each object. The technique was 
as the v the subjects to give as many responses 
the ALERT OA spontaneously, then summarize 
askin ape involved in the responses given, 
diako le subjects if there were any other 

cteristics of the object that suggested 


re 


Use r 
ise f e experimenter was prepared with a 
color. attributes for each object—such as 

> texture, malleability, solubility, con- 


notttys weight, and length—upon which he 

Stop responses made. When the subjects 

mises responding freely, the experimenter 
say, to illustrate, 


~ far the uses you have named involve 

Png strength, and hardness. Are there 

men other things about this — that sug- 
St uses to you? 


iets of the sort just illustrated failed to 
tecti; enough additional responses, more di- 
ej ie cues were given (e.g. “This - 
Su Shs something, doesn’t it? Does its weight 
Beest any uses to you?”). The experimenter’s 
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second role was to give verbal reinforcement 
(e.g, “Excellent!” “Very interesting idea!” 
“Good!” “Very good!”) for each response 
he deemed original. In brief, the procedure 
was similar to what other investigators have 
called brain storming. 

One group received high-variety training, 
in that 30 distinctly different objects were 
employed. The second group received low- 
variety training involving 30 objects falling 
into six different classes, with quite similar 
objects within classes. The six classes were 
fruits, boards, tin cans, lubricants, ropes, and 
abrasives. 

After training, a Novel Uses Test was ad- 
ministered. Subjects were asked to list as 
many uses as they could for each of four ob- 
jects, none of which was employed during 
training. It was explained that extra credit 
would be given for very unusual uses. 

The Novel Uses Test had been given pre- 
viously to 55 sixth-grade boys from an ele- 
mentary school in a different community. 
Exhaustive and, roughly, mutually exclusive 
response categories were developed for each 
object on the basis of these data (Anderson, 
1961). Each response category was given a 
scoring weight determined by the frequency 
with which it appeared. Responses that ap- 
peared in more than 15% of the protocols re- 
ceived no score. Responses that appeared in 
11-15% of the protocols received a score 
of 1. Responses that appeared in 6-10% of 
the protocols received a score of 2. Responses 
contained in 1-5% of the protocols received 
a score of 3. Responses not contained in the 
content analysis scheme received a score of 4. 
After eliminating repetitious responses, un- 
decipherable responses, and “nonfunction” re- 
the remaining responses were cate- 
gorized. A subject’s total originality score 
consisted of the sum of the scores he received 
for each object. 

Protocols from the Novel Uses Test were 
scored blind by one rater. The product- 
moment correlation between the total origi- 
nality scores assigned by two raters in the 
pilot study was 98. 

All subjects performed on three insight 
problems in separate sessions on successive 
days following the session in which the Novel 
Uses Test was given. The two-string prob- 
lem was presented first. A subject was pro- 
vided with a mouse trap, a basketball, an 
unbreakable saucer, a large handful of marbles 
placed in the saucer, a small plastic bag, six 
sheets of mimeograph paper, and a pencil. 
The subject was given 4 minutes to solve the 
problem. If he succeeded the object critical to 


sponses, 
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solving the problem was taken away, or, 
depending upon a prearranged plan of ad- 
ministration (Anderson, 1961), the subject was 
told to solve the problem another way. The 
subject was given additional 3-minute periods 
to solve the problem in other ways until he 
failed to solve the problem in some 3-minute 
period. 

The second problem, called the garbage can 
problem, was created by the investigators. A 
grate such as is found in an oven was se- 
cured to the top of a large, metal garbage can. 
A small metal can opener with a loop handle 
was placed in the bottom of the garbage can. 
The problem was to get the can opener out 
of the garbage can without tipping the garbage 
can or removing the grate. The subject was 
also furnished with a box of paper clips, a 
small plastic bag, two sheets of mimeograph 
paper, a large pair of scissors, a brick, a book, 
a broom handle with ends slightly rounded, 
a lump of modeling clay, and four 1-foot 
sections of glass tubing. If the subject solved 
the problem in the first 4 minutes he was 
given additional 3-minute periods to solve the 
problem in other ways until he failed to solve 
the problem in some 3-minute period. After 
each solution either one of the objects was 
taken away or the subject was told to “get 
the can opener out another way” depending 
upon a prearranged plan of administration 
(Anderson, 1961). 

The third problem was an adaptation of 
Duncker’s (1945) box problem that the in- 
vestigators have named the candle problem. 
A fiberboard panel, with a piece of Wrapping 
paper tacked to the front, was placed against 
a wall. The following objects were scattered 
on a nearby table: a paper cup full of 
wooden matches, a paper cup full of thumb 
tacks, a paper cup full of small candles, a 
screw driver, a synthetic sponge, a wooden 
ruler, a scissors, a paper punch, and a box 
of paper clips. When the subject was brought 
into the room, the experimenter made three 
marks on the sheet of paper attached to the 
front of the fiberboard panel and then asked 
the subject to “fix a candle on each of the 
spots I just marked” in such a way that the 
candles could burn without scorching the Paper. 
Five minutes were allowed to solve the prob- 
lem. If successful, the subject was allowed 
additional 4-minute periods until he failed to 
solve the problem in some 4-minute period. 
After any solution, either one of the objects 
was removed or the subject was asked to 
solve the problem another way, depending 
upon a prearranged plan of administration 


(Anderson, 1961). 
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The insight problems were presented by an 
experimenter who did not know which sub- 
jects were members of a training group 4m 
which were members of the control group: 
None of the objects involved in the insight 
problems was used during training. The prob- 
lems were presented to all subjects in the 
same order, namely, the two-string probleme 
the garbage can problem, and the candle 
problem. It was necessary to use the sa 
order of presentation, instead of a balance 
random order, so that the subjects who m 
performed on problems could be prevente 
from contaminating those who had not. 


RESULTS 


Differences among groups (see Tapit 
1) in scores on the Novel Uses T 
were highly significant (p e 
m = 2, m= 33, p < 001). The men 
originality of each training group tis 
significantly higher (p < .001) than up: 
mean originality of the control 80 he 
The difference in originality of the ot 
variety and low-variety groups Was 
significant. 

The number of solutions to 6 gr- 
the problems showed Poisson oF T É 
Poisson distributions. After a i 
root transformation had been APP ett 
Hartley’s test indicated that there W" 
hot significant differences among c+ 
ances and chi square goodness". 
tests showed that the distribution’ ity. 
not vary significantly from sa íf 
The mean and standard deviatlO’ 1, 
number of solutions (transforme; pe 
each of the problems for each ° 
groups appear in Table 1. vet 1953 

Analysis of variance (Lindquist, 5 ig 
Type I) indicated that there We" 
nificant differences among P" 
The F ratios for the among-grouP 
and the interaction were both les 
1.00. ov 

Total-sample correlations based As 
transformed scores of .20, -26; # prob 
appeared between the two-string the 
lem and the garbage can men probe 
two-string problem and the can 


ach of 


TRANSFER OF ORIGINALITY TRAINING 


TABLE 1 


Means AND STANDARD DEVIATIONS OF PROBLEM SOLVING PERFORMANCE AND 
ORIGINALITY SCORES 


Number of solutions * 


Gro Two-string Garbage can Candle All Originality 
roup problem problem problem problems score 
+ 
ws variety» 
pa 131 137 76 3.45 98.0 
91 4 E d j 
Low ui 9 91 89 1.87 23.7 
i 
SD. 1.38 1.24 9 3,52 89.4 
Control 64 48 95 1.4 29.9 
M 
SD 1.11 1.21 67 2 22.1 
All groups 79 37 87 131 19.8 
s 1.27 1.27 78 
p . 74 64 85 
; 
b are, root of number of solutions. 
test words. Both the Maltzman, 


le 
the and the garbage can problem and 
candle problem, respectively. 


DISCUSSION 


M eg procedures were notably 
Nove] ui In increasing the number of 
Objects, + subjects listed for familiar 
obtained The result is similar to that 
Berger by Maltzman, Bogartz, and 
jects peed a who, having trained sub- 
tions, f make uncommon word associa- 
limber a a significant increase in the 

of uncommon associations to 


Ay TABLE 2 
ANay 
YSIS OF VaRIANCE oF PROBLEM SOLVING 
PERFORMANCE 

Source dj MS F 
Gr 
ie (G) 3 33 < 1.00 
Tot, 33 76 
Proty between subjects ` 3 
Gap = SP) 2 289 5.25* 
Error k 8 < 1.00 


Ot ; 
al Within subjects 72 


“P< oy 


Bogartz, and Berger study and the 
present one suggest that transfer among 
highly similar tasks can be achieved in 
the area of “creativity” or “imagina- 
tion.” 

Training did not transfer to the in- 
sight problems. Indeed, the F ratios for 
both the among-groups effect and the 
groups X problems effect were less than 
one. Though the training groups did 
learn to produce unusual responses, the 
training was unsuccessful in increasing 
the likelihood that the subjects would 
give the particular unusual responses re- 
quired to solve the problems. 

Correlations of .01 and .70 appeared 
between originality and the square root 
of number of solutions to all problems 
for the pooled training groups and the 
control group, respectively. Though the 
latter coefficient was not significantly 
different from zero because of the small 
sample, a similar pattern of relationships 
was observed in the pilot study where 
the correlation for the training group 
was .05 and the correlation for the con- 
trol group was .31. Note that the Novel 
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Uses Test was administered after train- 
ing in each case. Apparently the train- 
ing interferred with the relationship 
between originality and performance on 
insight problems. . 

The low correlations among the in- 
sight problems indicate either that the 
problems are very unreliable measures 
or that something quite different is re- 
quired for the solution of each of them, 
both factors that would make a demon- 
stration of transfer difficult. And, of 
course, the sample was small and it may 
be that more intensive training or train- 
ing of a different sort would result in 
transfer. Still, the present study does 
not support the optimism, prevalent in 
some circles, that “massive generalized 
transfer of training” can be achieved in 
the areas of “intuition” and “imagina- 
tion.” At least, this study suggests that 
such transfer is going to be very difficult 
to demonstrate, requiring large samples, 
more reliable measures than have tradi- 
tionally been used in the area, and 
rather intensive, carefully conceived 
training procedures. 


REFERENCES 


ANDERSON, R. M. Positive transfer of an 
imagination set. Unpublished master’s the- 
sis, Rutgers University, 1961. 


Ricuarp C. ANDERSON AND Ricnarp M. ANDERSON 


CALLANTINE, M. F., & Warren, J. M. Learn- 
ing sets in human concept formation. Psy- 
chol. Rep., 1958, 1, 363-367. i 

Duncan, C. P. Transfer after training with 
single versus multiple tasks. J. exp. Ps 
chol., 1958, 55, 63-72. I 

Duncker, K. On problem-solving. Psychol. 
Monogr., 1945, 58(5, Whole No. 270). 

FLAVELL, J. H., COOPER, A., & LOIsELLE, R. 
Effect of number of preutilization functions 
on functional fixedness in problem-solving: 
Psychol. Rep., 1958, 4, 343-350. 

Gurrorp, J. P. Creativity, Amer. Psye 
ogist, 1950, 5, 444-454. ak 

Linnquist, E. F. Design and analysis of ee 
periments in psychology and educatio 
Boston: Houghton Mifflin, 1953. L 

Mattzman, I., Bocartz, W., & BERGE on 
A procedure for increasing word neod ‘ 
originality and its transfer effects. J 
Psychol., 1958, 56, 393-398. Wo 

Mattzman, I., Brooxs, L. O., BOGART be 
& Sumaers, S. S. The facilitation of P non 
lem solution by prior exposure to unco gg- 

responses. J. exp. Psychol., 1958, 56 
406. 

SEMNE, L. R. M., & WARREN, J. M 
tive facilitation of performance On $ 
consin Card Sorting Test. Psychol- 
1955, 1, 433-436. 

Wuson, R. C., Guirrorp, J. P. individu? 
sEN, P. R. The measurement of : i 
differences in originality. Psychot- 
1953, 50, 362-370. 


(Received January 1, 1963) 


hol- 


Journal of Educational Psychology 
1963, Vol. 54, No. 6, 305-315 


CHANGES IN CRITICAL THINKING, 
ATTITUDES, AND VALUES FROM 
FRESHMAN TO SENIOR YEARS * 
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To investigate changes in critical thinking ability, stereotypic beliefs, 


dogmatism, and values, a battery 


administered to 1051 students as freshmen and then as seniors. 


of cognitive and affective measures was 


The data 


were considered separately for males and females. The principal findings 


were that: (a) there is a 


unreceptivity to new ideas, (b) seniors are more 
they were as freshmen, (c) there is a significant impr 
and (d) seniors are not more homogeneo! 


thinkiug ability, 
attitudinal traits than freshmen. 


It 


significant decrease in stereotypic beliefs and 


“outer-directed” than 
ovement in critical 
us in certain 
was also shown that most of the 


changes took place during the freshman and sophomore yrs. 


ia tite the past decade, considerable 
diet est ñas been generated among psy- 
the ogists, sociologists, and educators in 
the Study of attitudes and values. Since 
in oe of Newcomb’s (1943) work 
of the 1930s, major longitudinal studies 
tëe € personality characteristics of col- 
Ond students have been and are being 
1956)" at Vassar College (Sanford, 
(Muy Sarah Lawrence College 
nell Tay & Raushenbusch, 1960), Cor- 
Wili niversity (Goldsen, Rosenberg, 
State Un & Suchman, 1960), Michigan 
19595 niversity (Lehmann & Ikenberry, 
1962)’ San Jose State College (Plant, 
(Foste and Santa Barbara College 
to n er, Stanek, & Krassowski, 1961), 
blogg a few. Although the method- 
might and instrumentation employed 
© an, have differed from one institution 
thesi Other, they all shared the common 
velon, of studying the personality de- 
Pment of college students. 

ough it is sometimes asserted that 
Ta research reported in this article was 
niteq Sa pursuant to a contract vith | the 

of Health tes Office of Education, Departme 
detaile, aaa Education, and Welfare. A more 
Critical En is to be found in the final report 
ighey penne, Attitudes, and Values în 
ucation (Lehmann & Dressel, 1962). 
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attitudes and values are instilled early 
in life and are most easily modifiable in 
infancy and adolescence, curriculum 
planning in our colleges and universities 
assumes that attitudes and values are 
still modifiable at age 17-22 or older. 
In fact, if we define education in its 
broadest sense, we might expect that 
there would be a change or reinforce- 
ment of certain ideals, beliefs, and in- 
terests of students from their freshman 
to senior years. 

Contradictory evidence has been pre- 
sented regarding the impact of college 
on student attitudes and values (Jacob, 
1958; Newcomb, 1943; Webster, 1958). 
At the same time, data have indicated 
that from the freshman to senior years, 
changes in attitudes and values will 
occur (Newcomb, 1943; Webster, 
1958), but that the degree and extent 
to which attitudes and values are modi- 
fiable depend upon the nature of the 
experience (Smith, 1955), the type and 
nature of the contact (McGuigan, 
1958), the personality make-up of the 
individual (Nelson, Blake, Morton, & 
Olmstead, 1956), the group’s approval 
of new attitudes (Rosenberg, 1956), 
and the subject’s perception of the out- 
come (Carlson, 1956). 
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One of the major faults of many so- 
called longitudinal studies has been a 
lack of any periodic study of the origi- 
nal population between the initial and 
final stages. Although this study does 
not claim to have considered or circum- 
vented all of the problems involved in 
longitudinal studies (for example, ab- 
sence of a noncollege control group), an 
attempt has been made to follow up the 
original population or random samples 
of it at various stages of their college 
careers. A 

The purpose of this paper is not to 
demonstrate whether college aids or 
facilitates the development of attitudes 
and values, nor are we concerned at this 
time with identifying those factors 
which might have an impact upon stu- 
dent personality development, We are 
primarily concerned with studying what 
changes, if any, occur in college stu- 
dents’ critical thinking ability; attitudes 
of stereotypy and dogmatism; tradi- 

tional value orientation; and religious, 
social, and political views from their 
freshman to senior years. 


DESCRIPTION OF ĪNSTRUMENTS UsED 


One instrument used was the Inven- 
tory of Beliefs (American Council on 
Education, 1950) which explores the 
students’ tendency toward (a) ideo- 
centrism, (b) ethnocentrism, (c) socio- 
centrism, and (d) egocentrism. It con- 
sists of 120 clichés, such as “a person has 
troubles of his own; he can’t afford to 
worry about other people,” “the best 
government is one which governs least,” 
“the worst danger to real Americanism 
during the last 50 years has come from 
foreign ideas and agitators.” The sub- 
jects respond to each item by means of 
a 4-element key: strongly agree, agree, 
strongly disagree, disagree. 

A high scorer is thought to be mature, 
flexible, adaptive, and democratic in his 
relationships with others; a low scorer 


immature, rigid in outlook, compulsive, 
and authoritarian in his relationships 
with others. Implicit in the develop. 
ment of this scale and the choice i 
items was the assumption that genera 
education makes individuals less ne 
typic in their beliefs. Some ea 
in general education courses shou 
therefore raise the scores of a 

A second instrument used was icai 
Test of Critical Thinking (Amer! ia 
Council on Education, 1953) which co i 
sists of 52 verbal, situational-type La 
lems designed to measure five ee 
thought to be involved in critical sol 
ing: the ability to (a) define a prob 
(b) select pertinent information, aap 
recognize stated and unstated, ts 
tions, (d) formulate and select re seat 
hypotheses, and (e) draw valid a a 
sions. It would be expected pelt 
effective general education ganren 
cause students to raise their score tory 

The Differential Values poe 
(Prince, 1957) which places a we con- 
values along a traditional-emerger 5 tri- 
tinuum was chosen as a third ais o 
ment. The scale consists of 64 Pe g 
statements, each pair containing jente 
ditional- and emergent-value oF ation 
item? The traditional-value orien* of 2 
or the emergent-value orientatio® oices 
student is determined by his ts such 
from among 64 pairs of amg wy 
as “Attain a higher position t yersus 
father or mother” (traditional) w jife 
“Enjoy more of the good thaige joved 
than my father or mother © jase? 
(emer ; “Feel that C? upee 

gent value); e üs Fee 

are born good” (emergent) ver (trad 
that children are born sinful fro” 
tional value). Scores can opine 
0 to 64 for the tote] test and 


tai? 

cony ae 

‘ ments jen 

2 Not all the pairs of statemen ine inst 


polar items. For example, a se pit 
tation item (traditional) may ie 
a sociability item (emergent) 


ey 
H jentatio’ 
polar item is a present time OF? 


ted 2 e 
tl ough i 
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16 for each of the subtests. A high score 
indicates a leaning toward traditional 
values; that is, the individual places 
high value on personal respectability, 
respect for others, feelings of guilt, 
thrift, and self-denial. A high scorer 
values hard work as good in itself and 
Necessary for success, places his personal 
and individual desires and beliefs equal 
to or above the desires and ideas of the 
group, and is willing to sacrifice present 
rigs for future reward and satisfaction. 
Se score indicates a leaning toward 
im emergent values, that is, toward the 
oe getting along with others 
sto achieving group harmony. A low 
ie er questions all absolutes, accepts 
aca ee morality, allows his 
ae to be governed primarily by the 
eigcae of others, and sacrifices 
ture goals for present needs. Using 
iesman’s classification, one might call 
eat traditional values “inner directed” 
dir the emergent values “outer or other 
me ” The scale yields a total score 
Be eight subscores: values of Puritan 
ae individualism, work-success 
fe future time orientation (the 
He arava score) ; sociability, 
im ormity, relativism, and a present 
ee Orientation (the emergent-value 
Core), 
tome Dogmatism Scale (Rokeach, 
See used to measure students re- 
ope ivity to new ideas, their degree of 
ie, mindedness, and their authoritar- 
4 attitude. This scale differs from the 
ditional California E and F Scales in 
hes it does not attempt to tie in au- 
Critarianism with conservatism OF 
comecentrism. The Dogmatism Scale 
nsists of 40 items such as “To compro- 
ee our political opponents is danger- 
ta because it usuaily leads to the be- 
ioa of our own side,” or “It is only 
es for a person to be fearful of the 
Na to which subjects respond by 
ans of a 6-clement “agree-disagree” 
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key (there is no neutral position). High 
scorers are thought to be dogmatic, 
closed minded, and unreceptive to new 
ideas. 

An Experience Inventory? especially 
constructed for this study (consisting of 
103 items) was designed to measure 
social and political attitudes such as 
“The United States should continue 
nuclear testing in the atmosphere,” 
“Medical care for the aged should be 
provided by the Federal government,” 
as well as attitudes towards the objec- 
tives of college (vocational versus lib- 
eral arts orientation), factors important 
for gaining prestige with students and 
faculty, and so forth. For the purpose 
of this study, we will consider only these 
items that relate to some behavioral 
change (either differences measured by 
a pretest and posttest or those men- 
tioned by students as self-perceived 


changes). 
METHOD 


The instruments previously described, with 
the exception of the Experience Inventory, were 
administered during orientation week to all 
freshmen (1,436 males and 1,310 females) 
entering Michigan State University in the fall 
of 1958. The only restrictions placed upon the 
population was that they be native-born 
Americans and attending college for the first 
time. Near the end of their senior year, this 
same battery of cognitive and affective tests, as 
well as the Experience Inventory, was adminis- 
tered to those students remaining in order to 
learn what changes had taken place during 
their 4 years at Michigan State University. The 
analysis of data is restricted to those students 
for whom we have usable pretest and posttest 
data. The findings and conclusions presented in 
this paper are based upon a sample of 1,051 
students (709% of the original group still en- 
rolled in college near the end of their senior 
year* and 39% of the original sample). 
——— 

3 Copies may be obtained from the author. 

4The test-retest sample consisted of 590 
males and 461 females. Tests of significance 
indicated that there was no significant differ- 
ence in initial status between these seniors who 
participated and those who did not participate 
in the senior year retest. 
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The ¢ test for correlated sample means was 
used to analyze changes in critical thinking, 
stereotypy, dogmatism, and traditional-value 
orientation scores for the population from their 
freshman to senior years. Because of initial sex 
differences on the cognitive and affective meas- 
ures studied, the data were analyzed separately 
for males and females. 


FINDINGS AND Discussion 


The data relative to changes in criti- 
cal thinking processes, attitudes of 
stereotypy and dogmatism, and tradi- 
tional-value orientation are: Presented in 
Tables 1-3. The data concerning self- 
perceived changes in typology and in 
attitudes and values are Presented in 
Tables 4 and 5, 


Reference to Tables 1 and 2 reveal 
that for both males and i 


Means, STANDARD DEVATH 
ABILITY, ATTIT 


‘ONS, AND “i 
ona, Pa oi OF SIGNIFICANCE FOR CHANGES IN CRITICAL THIN 
ALUES BETWEEN FRESHMAN AND SENIOR YEARS 


IRVIN J. LEHMANN 


tasks as the selection of pertinent in- 
formation, the ability to draw generali- 
zations and make conclusions, and the 
ability to formulate and select relevant 
hypotheses. There does not appear to 
be any evidence that one sex or the 
other changed more in this trait during ( 
their 4 years at college. 

2. Both males and females became 
less stereotypic in their beliefs from 
their freshman to senior years. In other 
Words, these students became more flexi- 
ble, less rigid, and less anithoritarin, 
during their 4 years at college, It woul 
appear that the females underwent 4 
more marked change than the males 
during this period. Although an analy 
sis of covariance was not performed, a 
fact that there is no significant sex di : 
ference initially, but a marked T 
difference at the end of the senior Y a 
does suggest, at least, that the females 
changed more than the males. This } 
indeed difficult to explain in terms er 
Curricular differences but might be a 
easily explained in terms of student SU 
culture differences between the 
Females, on the whole, both at the 
ginning and end of college tend to P 
more oriented to conformity and ee 
bility—to doing things to please other? 


Females (WV = 461) 
Measure Pretest Posttest r a 5 M i £ 
5 a Pretest Posttest r á 
Inventory of Beliefs Rra (7398 i Sane 3.72" 
Test of Critical $ S10) j 1.93 ia, (B87, 67 23.66 
hinkin; 2. + 4.91 
tat) Gih G ano g is a i 185 
Differential Values £ i ao 39.45 70-26. 
nventory 34.84 32.38 4 e 6.60) 11 
7.03) (761) O 3727+ a age 34.22 29.60 as 1379% * 
Dogmatism Scale 166.85 153.98 5 (6.87) (6.84) 98 
(25.61) (2294) 53 13.21% gjg 162.87 6 a müs w, 
(25.14) (24.16) ` 
Note.—# = test of significance for cor: 
SDs given i theses. telated mean: ; az= į iances. 
+p £05. oe RAEROARES Si BS test of Significance for correlated varianc 
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TABLE 2 


Means ax . 
S AND STANDARD DEVIATIONS FOR CRITICAL THINKING ABILITY, ATTITUDES, AND VALUES FOR 
MALES AND FEMALES AT DIFFERENT STAGES OF COLLEGE 


Beginning of End of End of End of 
freshman = freshman year? sophomore year” junior y senior year® 
n (Male N (Male N = 590, (Male N= 197, (Male) = 590. 
yi female N female V=461)° female N=217)° female N female N= 461)" 
Measure M M SD M SD M M SD 
Invi s " 
entory of Beliefs 64.77, 14.10. 67.00 14.68 Not given 73.68 13.67, 73.08 15.10 
(Not given) (75.92) (15.51) (78.67) (14.91) 


(65.99) (13.11) 


Test of Critical 


(69.32) (14.86) 


inking 37.51, 6.41 39.06 6.04 38.99 6.47, 39.72 6.11 
m GRAS) (6.53) (38.53) (6.31) (38.96) (6.71) (39.45) (6.60) 
‘ferential Values 

Satory 33.07 7.53. 32.25 78i q 3247 8.18 (32.38, 7.61 
Br g 3213) (704) (80.27) (6.87) * (29.76) (6.52) (29.60) (6:84) 
— 

matism Scale 166.85 25.6 Not given 156.31 24.21 Not given 153.98, 22.94 

d$ Gafa  (Notgiven) (151.03) (24.04) (Not given) (146.69) (24.16) 


$ Same subjects. 
andom sample of eligible population enrolled at 


bias į 
as inası 3 
minima, much as some of the subjects could have wit 


© Fir 
Firs? set of figures for males; those directly below in pi 


ongition, they appear to be more 
eit ae to outside factors insofar as 
they — is concerned—that is, 
pli to be more outer or other 
Was su than males. This latter thesis 
experi pported by an analysis of those 
very a college seniors felt had a 
their oe or reinforcing effect on 
evident avior, From this analysis, it is 
Percent that a proportionately larger 
eir T of females than males felt 
sions vends, roommates, and discus- 
marked; bull-sessions” had a very 
Value impact upon their attitudes, 
S, beliefs, and interests. 
ie of their close attachment to 
ity T because of their initial person- 
Ore Ìsposition, and because they are 
ideas ma minded and receptive to new 
that f an males, it is quite conceivable 
eci ai will be influenced or af- 
t to a greater degree than males by 
mores and demands of the peer 
in 5 What should be remembered, 
for Ch is that the direction of change 
lesse oth males and females is toward a 
tej ning of stereotypic beliefs and 
udices, 


Bron 


time of testing used. Although th 
hdrawn before their senior year, 


ere might, be some slight 
the number involved is 


arentheses for females. 


3. Both males and females became 
less traditional-value oriented from their 
freshman to senior years. In other 
words, they became less inner directed 
and more outer directed. They tended 
to become less absolute in their moral, 
religious, and ethical beliefs; had less 
regard for the “Protestant ethic” of 
Puritan morality; became more ques- 
tioning; and became more conforming 
to peer mores. Once again, it would 
appear that the females were more sus- 
ceptible to change than the males. Pos- 
sibly, the explanations advanced earlier 
are also true here. This does suggest that 
more research is needed to try and as- 
certain the reasons for this phenomenon. 

4. Both males and females became 
more open minded and/or more recep- 
tive to new ideas from their freshman to 
senior years, the females undergoing 
more marked change than the males. 

5. Although Jacob (1958) concluded 
that college students tended to become 
more homogeneous’ in their values from 
their freshman to senior years, the re- 


5 Increased homogeneity would be expected 
due to withdrawals from college. 
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sults of this study as well as those = 
ducted at Vassar (Sanford, 1956), do 
not completely support this view. Refer- 
ence to Table 1 reveals that for the 
males, there was significantly greater 
heterogeneity in traditional values (Dif- 
ferential Values Inventory) and signifi- 
cantly more homogeneity In receptivity 
to new ideas (Dogmatism Scale) at the 
end of the senior year than at the be- 
ginning of the freshman year. For the 
females, there is significantly greater 
heterogeneity in stereotypic beliefs (In- 
ventory of Beliefs) after 4 years of 
college. In other words, in only one 
instance, male dogmatism, was there 
evidence to Suggest a greater homo- 
geneity of values in the senior year than 
in the freshman year, I 
however, th 


change, 


increasing variances will be expected 
with age, at least to a certain age 
(McConnell, 1934, Matteson, 1955; 


Strong, 1943), J, 
theory, the stan 


mores, juniors, 


was also evident in the Vassar data 
reported by Webster (1958), 
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e 

Initially, it would appear pora k 
analysis of pretest and Lm think- 
that significant changes in i“ pe 
ing ability, attitudes, and valu Sa 
curred during the students’ 4 ye SA 
Michigan State University. “ part, 
ever, is not the case. For the cm oc- 
the greatest magnitude of ke 
curred during the freshman an 3. Fot 
more years as is revealed in Table ( from 
the changes in value orientation itica 
traditional to emergent) and Pe the 
thinking ability, it would appear some- 
greatest overall change took pare öl 
time between the beginning an ivable, 
the freshman year.* Tt is eon ada 
of course, that all or most of this g the 
change might have occurred durin year 
first few months of the freshman in- 
and even during the first few wee a 
sofar as the students’ values hy is 
cerned. What is significant, a 
that looking at changes betwee E 
freshman and senior years can 
misleading. 


Self-Perceived Changes 


. ce 
A Experien 
From the analysis of the ae that 
Inventory data, it is readily evi “ih 
er junior Y 
° It would appear that, after the u yalue 
a plateau was reached with Saat 
orientation of these college students. 


g AND 
x ALES * 
TITY, ATTITUDES, AND VALUES xor M 

FFERENT Sr, 


AGES OF COLLEGE 


o 
Sall 1958to Fall 195810 Fall 1958 to Fall 1956 5: 
na Spring 1959 Spring 1960 spring 1961 spring 

Inventory of Beliefs 2.330 E aK 7 
(3.33) = (9.93) go j 

Test of Critical Thinking 4.69 ga 6G ae 
(4.41) (5.46) (5.89) Ge 

Differential Values Inventory 1.73 —2.59 —237 -ien 
a) gs95) ies a 

Dogmatism Scale es SAOSA E = PID 

= (~11.84) = Ge 
^ First set of figures are males; those directly below 


in Parentheses for females. 
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these students perceived a marked 
change in their attitudes and values. In 
One section of the senior-year Experience 
Inventory, students were asked to clas- 
Sify themselves into one of four typolo- 
ig vocational, academic, nonconform- 
T and collegiate (see Footnote a to 
pee 4). In addition, they were asked 
fe their behavior when freshmen 
on assify themselves into one of these 
a : Reference to Table 4 reveals 
See ka these students were seniors, 
ard < that they were less concerned 
tear tending , college for vocational 
me than when they entered as 
Pak a in 1958. As seniors, they felt 
and Bly concerned with the academic 
as om aspects of college life as well 
ted Vocational. It should also be 
hh that the percentage of students 

might be described as trying to get 
one a minimum effort decreased 
Stites 4-year period. In addition, a 
seni tonately larger percentage of 

ors (in contrast to how they stated 


they felt as freshmen) said that the 
social life in college was not the most 
important but was certainly essential for 
one’s general development. 

Table 5 contains the responses to a 
variety of items (found in the senior- 
year Experience Inventory) describing 
changes (or lack of change) which 
seniors felt came about from their fresh- 
man to senior years in such areas as 
tolerance, religion, the value of a college 
education, and so forth. For each of the 
39 items, the student was asked “In 
what way are you different now from 
what you were as a freshman?” He re- 
sponded to each item by means of a 3- 
element key: I possess more of this 
quality; I possess the same amount of 
this quality; I possess less of this 
quality. From Table 5 one might con- 
clude that: 

1. A majority of students indicated 
that they have changed in one direction 
or another in their attitudes, values, 
opinions, and beliefs from their fresh- 


TABLE 4 


Srntors’ SELF-PerceiveD CH 


ANGES FROM FRESHMAN TO SENIOR YEARS 


Type and number responding 


Item W X ¥ Z 

Whi E — a 

i of the above (W, X, Y, Z)" comes closest z ak m 

” describing the kind of person you consider 320 21 3 

waned) "f 2 i 29.190 690 89 290 
Pei ie hese (29.196) (19.6%) (398%) (11.2%) 

hi x 

ich of the above is least descriptive of the kind 210 278 a N 
y Person you consider yourself to be now? (19.190) (253%) (3.79) (51.97%) 
Whi j iiinis 

Ich of apse 

the abov losest to describing 
the vc above comes clos 5 
bis kind of person you were when you first 459 173 258 205 
me to MSU? (41.9%) (16.0%) (231%) (19.0%) 

hi ‘ete 

fe of the above comes closest to describing s 

ha kind of person you would like to be if you 114 330 604 ied 

d the choice? ` (10.49%) (30.0%) (549%) (40%) 

Cat Note — The table i ca W 41.99% of the seniors felt that as freshmen they fell in 
be ty w. eiaha feto Pe ee eN eey fell i Category W. The ‘first and third items should 


a p Verti : 
cupa e caliy and not horizontally. 
Rotivayenal training. X— 

© mod by intellectual curiosity. 

important but is certainly 
o “make grades” but will 


Qe, 
For the most part. 


essential for 


WF most part, this persi 
For te Tor tk on's Pison would consider himsel 


—For the most part, this person Ícels tha 
his general development. Z— 


rarely go out of his way t 


o do extra or non-assigned readings. 
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TABLE 5 


yi J VALU: sp V YEARS 
H AN IEWS ESH: v TO SENIOR 
¢ UES, AND VIEWS FROM FR MAN 
$ ANGES IN ATTITUDES, VALUES, 
SELF-PERCEIVED 


In what ways are you different now from what 


Percentage responding? 


Same 
you were as a freshman? More Less 
Tolerance of people differing in race, creed, color, 68 (33) 7 (8) a Pa 
us 1 
eo for the views and opinion of other People 80 (82) ; a 20 (16) 
Respect for views and opinions opposite to mine 76 (80) 
Tolerance of unconventional dress, behavior, and PA 1 (13) 31 na 
Tent into the behavior of other people 85 (93) 2 (1) “| (24) 
Ability to get along with other people 73 (73) 343) 33 (32) 
Interest in political matters” 60 (60) 7 (8) 27 (25) 
Interest in social issues 68 (71) 5 (4) 23 (14) 
Interest in intellectual and cultural matters 73 (84) 4 (2) 24 (35) 
Interest in scientific developments 70 (60) 6 (5) 21 (21) 
Interest in world affairs 77 (76) 2 (3) 22 (20) 
Ability to adjust to conditions not to my liking 73 (74) 5 (6) yı (29) 
Ability to accept disappointment 64 (67) 5 (4) i5 (20) 
Ability to change my views in the presence of facts gq (78) 1 (2) 14 (13) 
Confidence in my ability to deal with new problems 82 (83) 4 (4) 19 (19) 
Responsibility for my own behavior 80 (80) 1 (1) 29 (33) 
Dependence on class attendance for learning 28 (28) 43 (39) 
Feeling that the quality of one’s education depends 24 (23) 
on jhe institution rather than the individua 13 (10) 63 (67) 33 (28) 
Dependence on my age group for behavior patterns 11 (10) 56 (62) 55 (56) 
Acceptance of the Bible as a guide to modern living 11 (13) 34 (31) 
ttachment to a religious sect or denomination that 51 (49) 
T can believe in and defend 12 (17) 37 (34) 55 (68) 
Respect for law 34 (25) 11 (7) 9 (55) 
Respect for rules and regulations 28 (18) 23 (27) f (62) 
Respect for persons in positions of authority 35 (20) 16 (18) HA 62) 
Feeling that money is of Primary importance 12 (11) 38 (37) 0 
Desire to accept a job for the Satisfaction it has to (34) 
offer rather than the salary it pays 61 (58) 9 (8) a (49) 
Drive to get ahead as quickly as possible 50 (27) 14 (24) a 
Feeling that a major aim of college is to Prepare (35) 
one for a vocation or profession 33 (20) 36 (45) 31 
Feeling that a college should also stress a liberal- (26) 
arts-type of education 66 (68) 9 (6) 25 
Feeling that a college education is necessary to (27) 
succeed in the world 59 (59) 13 (14) 28 (23) 
Importance of grades as Measures of achievement 18 (11) 61 (66) a (5) 
Confusion as to what I want out of life ` 21 (21) 56 (64) es (22) 
Optimistic outlook for my future 64 (68) 10 (10) 26 (21) 
Pessimistic outlook for my future 8 (8) 67 (71) 25 GD 
Optimistic outlook for future of civilization 45 (39) 20 (29) 28 (30) 
Pessimistic outlook for the future of Civilization 20 (27) 47 (43) 3 
Feeling of the necessity for religious faith for living 3 (37) 
in modern times 33 (40) 29 (23) re (43) 
Commitment to a set of religious beliefs 20 (24) 34 (33) aa (9) 
Awareness of my goals in life 75 (82) 8 (9) 


* First set of figures is for males (N = 645); figures in parentheses are for females 


(N = 439). 
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n to senior years. For every item, 
a it is readily evident that some 
és ents believed they did zot change in 
ia particular respect. This, inciden- 
ial might be desirable for lack of 
door in some people is as desirable as 
ge in others. 
Ms Tor the majority of items, there 
fie no appreciable differences in the 
a ee of males and females respond- 
this i more, the same, or less of 
k i ity now than I had as a fresh- 
Riches Some of the marked discrep- 
ately he as follows: A proportion- 
ee arger number of females than 
ra Bey that since their freshman 
more they felt that they had become 
fial Anterested in intellectual and cul- 
that oe less inclined to regard 
ER e major aim of college was to 
ao e one for a vocation or profession; 
ot ae as to what they wanted 
fe: J ife; more aware of their goals in 
fe fae dependent on their peer group 
uncon avior patterns; more tolerant of 
hs ir dress, behavior, and 
iferi rs; and more tolerant of people 
igio ng in race, creed, color, and re- 
n. 
a an percentage of students felt 
termod ey changed in what might be 
ample a negative direction. For ex- 
they k some students indicated that 
erin ecame less tolerant of people dif- 
RE iy race, creed, or color; that they 
temia less respect for law, rules, and 
Optimi lons; and that they had a less 
fi istic outlook for their future. 
< Students became more respectful 
e views and opinions of other 
€ while they were at college. Al- 
dere there had not always been a 
"egard in their views and opinions with 
tion to some issues such as desegrega- 
Unio d™mittance of Red China to the 
hte Nations, oF continuation of 
tea dis testing in the atmosphere, it 18 
Y evident that a sizable portion of 


of 


Peg 
ae 


the students developed the ability to 
listen to the opinions and views of others 
before drawing any conclusions, 

5. Although a proportionately larger 
number of both males and females felt 
that as seniors (in contrast to their be- 
havior as freshmen) they had developed 
greater interest in political matters, 
social issues, and world affairs, these 
data might be misleading. For example, 
in the interviews with sophomores and 
juniors, it was readily evident that these 
students were self-centered and rather 
apathetic insoiar as world affairs were 
concerned. In fact, the only time they 
became interested or concerned was 
when the world situation threatened to 
involve them personally. For example, 
they expressed concern about the Congo 
and Katanga because many felt this 
might develop into another Korea and 
that they would be drafted. Other than 
this, they had very little interest in 
world affairs. 

6. A proportionately larger number of 
both males and females in their 4 years 
at college was weaned from home and 
became independent. They developed 
greater confidence to deal with new 
problems, became more responsible for 
their own behavior, and less dependent 
on their peers for behavior patterns. No 
doubt similar findings would have been 
obtained had a noncollege population 
been studied. It would appear that 
these changes are no more than a re- 
flection of the maturation process. It is 
conceivable, of course, that college 
attendance acted as a catalyst. 

7. In reference to changes in religious 
values and/or the value or need for re- 
ligion, it would appear that the data are 
contradictory since people might change 
in one but not in the other or vice versa. 
For example, after 4 years of college, 
36% of the seniors stated that they be- 
came less attached to a religion that 
they can believe in and defend while 
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14% of the seniors felt that in this 
period they became more attached; 
34% stated they became less commit- 
ted to a set of religious beliefs versus 
22% who felt they became more com- 
mitted; nearly three times as many stu- 
dents (363 versus 132) became less in- 
clined rather than more inclined to 
accept the Bible as absolute and in- 
fallible. Nevertheless, these changes are 
not accompanied (in direct proportion) 
to a decrease in the numbers who have 
less feeling for the need for religion. If 
this were the case, we shóuld have seen 
about twice as many of these students 
feeling less (rather than more) need for 
religion and this is not so—35% stated 
that they felt more need for religion 
versus 26% of the sample who felt they 
have less need, 

8. For a large percentage of these 
students, money was now subordinate to 
the satisfaction to be gained from a job. 
At the same time, a Proportionately 
larger number of males than females 
felt that they had more drive to get 
ahead as quickly as possible. This find- 
ing is rather difficult to reconcile with 
the previous one inasmuch as one nor- 
mally tries to advance rapidly for mone- 
tary gain. 

9. A proportionately larger number 
of seniors (in contrast to 
freshman) no longer felt ¢ 
aim of college is to prep 
vocation but that each s 
be provided with a libera 


their views as 
hat the major 
are one for a 
tudent should 
l education. 


CONCLUSIONS 


There is no denying the 
changes in critical thinking al 
titudes, and values occur from the stu- 
dent’s freshman to senior years in col- 
lege. It is difficult, however, in the 
absence of a noncollege control group to 
relate these changes directly to college 


fact that 
bility, at- 


education. In fact, in interviews with 
sophomores and juniors, it is evident 
that the informal, nonacademic experi- 
ences such as friends, persons dated, 
“bull-sessions,” and so forth have 4 
greater impact upon personality devel- 
opment than do the formal, academ:¢ 
experiences such as courses and instruc- 
tors. Moreover, it is only after the stu- 
dents entered their major that any we 
dence of the impact of formal academ! 
experiences appeared. t 
For these college students, the grea 
est changes in attitudes, values, om 
critical thinking ability take place jo 
ing the freshman and sophomore ae 
What is significant at this time in 
students’ lives? Are students mony of 
ceptible to the influence of we this 
dent subculture and its mores at oe 
lime? Is dormitory living, with its ee 
action of different personalities, ent 
and interests, a partial explana 
Would the same changes (degree stu- 
direction) have occurred had these $ 
dents not attended college? * ss i 
Since the informal, nonacademic ©” 
Periences are mentioned by these va 
dents as being more potent during t : 
freshman and sophomore years ae i 
the formal, academic experiences, ! es 
conceivable that the observed sen 
are not necessarily due to educati? pe 
activities deliberately undertaken bY ess 
college. Even if the maturation pr0° a 
is the single, most important age 
this time colleges and universities sie 
Still attempt to isolate and to coe 
those experiences which are most velop” 
tive in influencing personality devè 
ment, 
i jè 
7 Plant (1962) reported no significant or 
crease in ethnocentrism and dogmatism * y- 


oP 
4 years between a college and noncollege P that 


lation, Brown and Bystryn (1956) shai ge 
time Spent on college had little beari 
authoritarian changes. 
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RELATION BETWEEN WORD-RECOGNITION 
ERRORS AND HAND-EYE PREFERENCE 
IN PRESCHOOL CHILDREN? 


SIEGMAR MUEHL 
College of Education, University of Iowa 7 


Handedness and eyedness tests were administered to 62 preschool children 
at 2 age levels. Evidence for visual orienting behavior was obtained from 
a 20-item word-recognition task. Ss matched each stimulus word with 
4 response choices designed to elicit a correct response, or a left, middle, or 


right recognition error. 


among types of recognition errors. 


left errors decreased more than oth 


Ss in both age groups made more correct re- 
sponses than any type of recognition error. 


There were no differences 


Correct responses increased with age; 
er errors. 


Ss classified as left Jateral, 


either in hand, eye, or both, made more combined left and right errors 
than did right hand-eye Ss. The findings considered with related research 


Provided additional evidence that left later; 
with unique patterns of Perceptual behavior, 


ee 


Word recognition for the beginning 
reader depends upon his learning a 
sound-to-spelling relationship. The basis 
for this relationship requires not only 
discrimination of the letters which form 
a word, but also orienting to these let- 
ters in a left-right order, 

Teaching children this left-right ori- 
enting behavior is Part of the instruction 
program in beginning reading. Two 
questions pertinent to this instructional 
task are: Do Prereaders, when presented 
with a stimulus pattern involving a 
printed word, have any tendency to 
orient either to the left, right, or middle 
of the word? Does this tendency, if it 
exists, relate to hand-eye preference? 

Gates and Boeker (1923) and Meek 
(1925) investigated the first of these 
questions, using nursery school and 
kindergarten children, When word-rec- 
ognition errors and letter similarities 
among words were examined, both 
studies found the most frequent error 
associated with end-letter Similarities 


1The author wishes to thank 5, Kreitzer 
for his role in testing the children and for his 
many useful suggestions in Planning the ex- 
perimental procedures. 
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ality in prereaders is associated 


ied the 
among the words. Meek reported. dle- 


least number associated with mi ind- 
letter similarities. None of these ili’ 
ings, however, was tested for relia rill 
The second question has not Pave 
rectly studied. Stevenson and Jation 
son (1953) investigated the i direc 
between hand-eye preference and chil- 
tional tendencies in kindergarten ing 
dren prior to reading instruction. sals, 
a variety of tasks to measure TEV - 
they found a significantly gremet chil- 
ency for right-handed, right-eye in 
dren to arrange a series of pictures 
left-right direction as compared left- 
right-left direction for right-handed, 
eyed children. was 
The purpose of the present study in 
further to investigate visual P stimu 
behavior as it relates to word $ ers: 
and hand-eye preferences in prerea 


METHOD 


Handedness Tests from 
ri 
Tests for hand preference were adapted wa 
Updegraff (1932), Preliminary testi at and 
done to select items eliciting uni ek con” 
hand-consistent responses. The final with * 
sisted of six items including: coloring 


te eo paper, hammering, building a 
ah th ridge, spooning marbles into a cup, 
foams a ing a ball. Handedness scores ranged 
keh 6, be aes 0 indicating consistent left 
lindra a indicating consistent right 
ioe and long-term reliability of the 
hay eee test was estimated from prelimi- 
ee a ing. For 23 preschool subjects tested 
vs) oe from 1 to 16 days (mean of 12 
à n “i mean change in score was .65 with 
jete E rom 0 to 3 points. Twenty-one sub- 
tested pt 1 point or less. For 13 subjects 
mean an retested at a 10-month interval, the 
points ae was 1.01 with a range from 0-3 

- Nine subjects changed 1 point or less. 


Eyedness Test 


Pete: objective tests for eyedness were 
tests rog from Hildreth (1950). Two of the 
x8 ee the subject to sight through a 
in the ch board with a 3-centimeter hole cut 
mounted anda. _ This sighting board was 
test, th for vertical adjustment. In the first 
length Fhe was seated in a chair at arm’s 
Was att, rom the board. The sighting board 
to the ached to the end of a table and adjusted 
Sat at Fe ig height. The experimenter then 
from the opposite end of the table about 4 feet 
White PS Subject, exposed a small black and 
throy pere; and asked the subject to look 
Saw, i the hole in the board and tell what he 
adjusted the second test the sighting board was 
Subject gt? the subject's standing height. The 
look is instructed to walk up to the board, 
Picture ogh the hole, and report what the 
the aiin The third eyedness test required 
Vato ject to sight through Miles’ (1930) 
three Be In each of the three eyedness tests, 
Picture eins trials were given, using different 
the S a The experimenter observed which eye 
Eye subject used in sighting in each case. 
dic in scores ranged from 0 to 9, with 0 in- 
RG co 8 consistent left eyedness and 9 indicat- 
on Stent right eyedness. 

desg rt- and long-term reliability of the eyed- 
testi; est was estimated from the preliminary 
tetest For 23 preschool subjects tested and 
the ed from 1 to 16 days (mean of 12 days), 
ftom a change in score was .74 with a range 
; Point © 3 points. Nineteen subjects changed 
or less between testings. For 13 sub- 

ested and retested at a 10-month in- 
fro, the mean change was 1.23 with a range 
to 5 points. Nine subjects changed 
or less; only one subject changed as 


aS 5 points. 
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Word-Recognition Task 


The apparatus for presenting the word 
stimuli consisted of a 22 inch slide projector 
and an 814x11 inch white translucent glass 
screen mounted at the end of a box tunnel 
214 feet in length. The projector was located 
at the end of the box tunnel to the rear of the 
glass screen. By this means the projector light 
was confined to the tunnel and the image 
projected on the back of the screen. When the 
subject faced the screen, the word stimuli ap- 
peared white on a black background. The 
screen itself was so masked as to present two 
openings. Centered at the top was a 24-inch 
square opening where a single stimulus word 
appeared. At the bottom of the screen was a 
114x11 inch opening where four response 
words appeared. The four words were equally 
spaced across the long dimension. The stimulus 
and response words were presented simul- 
taneously. Each word measured on the screen 
about 20 millimeters in length and 7-10 milli- 
meters in height. Directly in front of each 
response word was a red button. The button 
served to indicate a discrete response by the 
subject, and, in the case of a correct choice, 
appeared to make the stimulus words disappear 
from the screen. Actually the slide projector 
was activated by the experimenter using a 
hidden control. 

The words used in the recognition task were 
typed in lower case and mounted on cards to 
be photographed for slides. A total of 24 word 
sets was prepared. A word set consisted of a 
four-letter stimulus word, mounted at the top 
of the card, and four response words mounted 
at the bottom. Three of the response words 
contained rearrangements of the letters in the 
stimulus word. The letter rearrangements were 
designed to detect visual orienting responses 
directed to letter sequences either at the left, 
middle, or right of the stimulus and response 
words, to the exclusion of the remaining letters. 
The fourth response word contained the same 
letter arrangement as the stimulus word. Thus, 
when “girl” appeared as a stimulus word, the 
response words were: “gilr,” “lrg,” “igrl,” and 
“girl.” The choice of “gilr” indicated a left- 
orienting response and was scored as a left- 
recognition error; “lirg” a middle orienting 
response scored as a middle recognition error; 
“igrl,” a right-orienting response scored as a 
right recognition error. The choice of “girl” 
was scored as a correct recognition response. 

The 24 word sets were divided into 6 blocks 
of 4 sets each. The positions of the 4 types of 
response words were counterbalanced within 
each block so that each type appeared in all 
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4 positions. One of the 6 blocks is illustrated 
in Table 1, 

In addition to the word sets, 4 sets were 
prepared containing familiar geometric forms 
including a square, a rectangle, a circle, and 
a triangle. Each form served as a stimulus 
and a response. Counterbalancing the re- 
sponses was similar to the word sets. 

The word-recognition task was preceded by 
two preliminary tasks. In the first, called the 
instruction-learning task, the 4 sets of geo- 
metric forms were used. In the second, called 
the word warm-up task, 4 word sets were 
used. The main recognition task consisted of 
the remaining 20 word sets. 

When the subject was seated in front of 
the glass screen, the first geometric form set 
was presented. The subject was instructed 
(a) to look at and point to the form appear- 
ing in the top opening of the screen, (b) to 
look below and find a picture that looked the 
same, and (c) to push the button in front of 
that picture. If the subject’s response was 
correct the picture disappeared. If incorrect, 
the experimenter pointed to the correct pic- 
ture and pressed the button. In addition, for 
the first two sets, the experimenter pointed 
to each one of the responses, asking the sub- 
ject each time whether this picture was the 
same as the one above. The subject was shown 
the four geometric sets twice. A criterion of 
six of eight correct responses was required to 
continue. No subjects were dropped for fail- 
ure to reach this criterion in the instruction- 
learning task. The word warm-up task fol- 
lowed immediately. The instructions for the 
first two word sets were identical to those 
used with the geometric forms except “word” 
was substituted for “picture.” On completion 
of the fourth warm-up set the subject was 
told he would see some more words and was 
to try to see how many he could get right. 
Throughout this task the subject was given 


TABLE 1 
SAMPLE BLOCK oF RESPonsE Worps 


COUNTERBALANCED FOR PRESENTATION 
Position 


Button position 


SSS 
1 2 3 4 
gilr igrl lirg girl 
look kool olok loko 
ujmp jupm jump pumj 
eosr rose roes orse 
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verbal encouragement and reminded to ae 
at all the words before pressing the non 
The primary incentive, however, was to ie r 
the words disappear. The subject receive 
toy on completing the task. 

With most subjects, the handedness fy : 
eyedness tests and the word-recognition the 
were administered in the same session; ; 
session required was 20-30 minutes. , 


Subjects 


the 
The subjects were 62 children sree jols 
University and Parent's Cooperative Leann 
at the University of Iowa. Four addi they 
subjects were eliminated: two Beau j- 
could read, and two because they were 4 
dextrous with respect to eye preference ups 
subjects were divided into two age nments- 
based on their preschool group ent from 
Group CA IV consisted of 23 subjects "157 
the younger groups with a mean 3% snot 
months, and a range from 43 to “t ts from 
Group CA V consisted of 39 SUDIRS 58.2 
the older groups with a mean age nths- 


mo 
months, and a range from 53 to 63 
RESULTS 
Handedness-Eyedness Tests 
were 


Four different hand-eye grOUP® at - 
constituted from the results of the rou 
edness and eyedness tests. These Dje 
are shown in Table 2. Only eat of 
giving evidence of a preferred 
eye were included. n 
"tn the handedness test, subjert 
ing from 0 to 2 were classed 5a et 
handed and from 4 to 6 as right “ z 
The distribution of handednesi, of 
markedly bimodal with the maJ° 


scot” 
Jeft 


TABLE 2 p 
g GRO” 
NUMBER or Susjecrs ın Hanv-Ev! E 


Hand-eye “CA Iv cav © 
———— 34 
Right-right (RR) 10 24 14 
Right-left (RL) 6 8 6 
Left-left (LL) 2 4 8 
Left-right (LR) 5 3 62 


Total ia 


Worp Recocnition AND HAND-EYE PREFERENCE 


subjects scoring either 0-1 or 5-6. On 
the eyedness test, subjects scoring 0-3 
were classed as left eyed and from 6-9 
right eyed. The distribution of these 
Scores was also bimodal, with the ma- 
Jority of subjects scoring either 0-1 
or 8-9, i 
Moi assess the effect of handedaess and 
+ aig on type of word recognition 
sth the groups appearing in Table 2 
= variously combined to make six 
€gories of pairs for purposes of com- 


Parison. : À 
EEA Mi categories are described 


Word-Recognition Task 


Ed of the six pairs of hand-eye 
By = hown in T able 3 was compared 
VI ao a Lindquist (1953) Type 
and he ysis of variance. To obtain age 
Was ie de group proportionality, it 
a eng: in some instances to drop 
and = on a random basis (see Tables 
eye ). In the analyses, age and hand- 
Stoups within each category were 


TABLE 3 


Hanp-Eye 
Nb-Eye Groups COMPARED IN THE 
Various ANALYSES 


Laterality 


Comparison 
characteristics 


categories 


1, 
RR Versus RL 


2 por a4)" Consistent ver- 
R+LL versus RL+LR sus mixed 
LR (24) (22) hand-eye 
RLR versus LL 4+RL_ Right eye ver- 
4. RRE? (20) sus left eye 
+RL versus LL-+LR Right hand ver- 
(32) (14) sus left hand 
Consistent right 
5, RR versus consist- 
Bo versus LL ent left hand- 
) (6) eye 


Consistent right 
versus left, all 


6 
R 
G Versus RL-+LR+LL s left 
combinations 


(25) 


` 
tia N z 
lonaggnber of Ss in groups when combined propor- 


Y according to age. 
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compared for all pairs of response 
choices, making a total of six compari- 
sons.? For example, in the right-right 
versus right-left category, the six 
analyses included comparisons between: 
(a) correct responses and left recogni- 
tion errors, (b) correct and middle, (c) 
correct and right, (d) left and middle, 
(e) left and right, and (f) middle and 
right recognition errors. The main ef- 
fects in each of these analyses were: 
response choice as the within factor; 
age and hand-eye groups as the between 
factors. The findings are summarized 
under the main effect headings. Re- 
sponse choice and age data were based 
on Category 3 (see Table 3) analyses 
for the maximum number of subjects. 


Response Choice 


Table 4, fourth column, shows the 
means and standard deviations for the 
four response choices in the word-recog- 
nition task for the combined age groups. 
Comparisons among the response choices 
showed a significant difference between 
correct responses and each of the three 
kinds of recognition errors (p<.001). 
Differences among left, middle, and 
right recognition errors were not signifi- 


cant (p>.05). 


Age 

There was a significant interaction 
between age and type of response when 
correct responses were compared with 
left (p<.001), middle, and right word- 
recognition errors ( p<.05). The trend 
of this interaction is shown in Table 4, 
Columns 2 and 3, Thus, comparing cor- 
rect responses and left errors for the two 
age levels, it is apparent that correct 
responses increased with age and left 
errors decreased. The interaction pat- 


—_—— 

2 The analysis by pairs of response choices 
was considered appropriate since these meas- 
ures were not independent. 
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TABLE 4 


Response CHOICES IN THE Worp RECOGNITION 
Task By AGE Groups* 


Response CAIV CAV Combined 
choice (N = 22) (N=33) (N =55) 
Correct 
M 7.05 10.15 8.91 
SD 3.52 4.02 4.12 
Left error 
M 5.09 3.48 4.13 
SD 3.37 1.09 2.63 
Middle error 
M 3.77 2:79 3.18 
SD 2.04 2.31 2.26 
Right error 
M 4.05 3.58 3.76 
S.D. 2.03 2.34 2.23 


a Data from Category 3 analysis for maximum N. 


tern was similar but not as marked 


when correct responses were compared 
with middle and right errors, 


Hand-eye groups 


Comparisons between hand-eye groups 
in the six categories described in Table 3 
showed two significant differences. When 
right-right subjects were compared with 
left-left subjects, age collapsed (Cate- 
gory 5), it was found that the left-left 
subjects made significantly more com- 
bined left and right recognition errors 
(p<.05). The mean combined errors 
for the right-right and left-left groups 
were 6.90 and 10.42: the standard 
deviations were 3.23 and 2.77, respec- 
tively. 

Similar results occurred when right- 
right subjects were compared with sub- 
jects having left-laterality of either 
hand, eye, or both (Category 6). The 
mean combined left and right errors 
were 6.80 and 8.92; the standard devia- 
tions were 3.28 and 2.98, respectively. 
The difference was significant (p< 
.025). In category 6, the sex distribu- 
tion showed 8 boys and 17 girls to be 
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right-right and 14 boys and 11 girls 
to be either right-left, left-right, or left- 
left. A chi square test, using Yates cor- 
rection, was not significant. 


DISCUSSION 


The purpose of the present study m 
to investigate visual orienting behav! 
and its relation to hand-eye preferenc? 
in prereaders. Orienting behavior n 
indicated by type of recognition ett? : 
made in a word-matching task. Age 3 
ferences among the preschool childr 
made age an additional factor. 

The findings with respect to 
recognition errors did not indica 
overall tendency for prereaders to a 
more left than right errors. The a ign 
tendency to make fewer recog”! ies 
errors based on middle letter similarib : 
though not significant, was similar . 
Meek’s (1925) findings. The sie ye 
cant increase in correct responses 20r ie 
5-year group suggests that the ° 
child has learned, to a greater 
the habit of orienting to a total 
pattern before responding to it. 
this more efficient orienting bel tte 
accompanied by a left-to-right Pê any 
of viewing word stimuli was not © ehe 
measured by the present results- m 
marked decrease in left errors 30° e 
panying the increase of correct resp? at 
for the 5-year group may indicata in 
when the 5-year-old orients to the snitia! 
ning of a word he follows this ” win 
orientation with a left-to-right Vi" pe 
response. This directional aspect °- {pe 
response could be accounted for y ith 
older child’s greater familiarity san 
picture stories in books an to” 


word- 
te an 


stimulu 
whethe 
navior | 


left 


Papers,” both of which require @ “torf 
tight viewing to follow the 
sequence, ecl® 


The finding that left-lateral SUP} ion 
made more left and right recog? yb 
errors than consistent right-latet®, “pe 


jects, although indicating no J 
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tween laterality and a particular direc- 
tional viewing tendency, does indicate 
a lag in learning to orient and/or 
ee to the total word pattern for the 
eft-lateral subjects. When considered 
with the results reported by Stevenson 
and Robinson (1953), this finding pro- 
consistent evidence that left lat- 
= ity in prereaders is associated with 
bene patterns of visual or perceptual 
ie These patterns could affect 
in recognition efficiency in later read- 
ra hough Stevenson and Robinson 
iets ) reported that their right-hand, 
in ny group had no problems in learn- 
side read, these children were con- 
Chita ly above average in intelligence. 
i ren combining left laterality with 
rie ais or below average intelligence 
ieee have more difficulty in learning the 
Pe visual and perceptual habits. 

ie is connection, it is interesting to 
aan he observed tendency in the pres- 
oa for a greater proportion of 
ing nan girls to be left lateral, a find- 
Mencia 5 with data reported by 
age ney (1922) based on a comparable 
girls PR Considering the fact that 
achie o better than boys in reading 
D. ay (Smith & Dechant, 1961, 
lao this finding suggests a sex-linked 
teta ton between early left laterality, 
tded orienting or perceptual be- 


havior, and subsequent reading achieve- 
ment. 

A follow-up study of the laterality 
status and reading achievement of chil- 
dren used in the present study is 
planned. 
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COMPARISON OF ADOLESCENT AND ADULT 


BEHAVIORAL NORM PROPERTIES ' 


ROBERT D. STROM 
Department of Education, Purdue University 2 


Responses of 303 high school sen 
naire concerning 6 behavioral 
adolescents and adults diffe 
whether certain types of ad 
norms than others. Subseque 


(based on leadership and 


subpopulation variables, 


In the past few years sociologists, 
psychologists, philosophers, and educa- 
tors have expressed concern over the 
problem termed by Coleman (1961) as, 
“the emergence of an adolescent sub- 
culture in an industrial society [p. 3].” 
Coleman refers to the changes in Ameri- 
can culture which have served to bring 
about the separation of teenagers from 
the adult society, thereby encouraging 
youngsters to seek more and more peer 
approval for their behavior. Conse- 
quently, teenagers within their subcul- 
ture have developed norms of behavior 


which are believed to be quite divergent 
from those held by adult s 


; oles- 
and (ò) whether certain types of e 
cents are more ready to accept : 
norms than others. 


METHOD 
Subjects 


s07 

As a consequence of the complex adun l 
ciety, no individual or group can repre te 
of its facets, but it is generally accep 
adults that the teacher does at Teast ^ tant 
petent job of communicating the imp scents, 
values and standards of adults to ey a A 
Therefore, assuming that the behaviora s 
of teachers are somewhat representative ical t° 
standards of adult society, it appears lo scents 
compare the norms of behavior for ado 


> es 
ociety. $ i to dete’ 
s n with those of their teachers in order ado- 

The purpose of this study was to in- mine the extent this group of adults md 303 
vestigate the norms of behavior for the lescents agree. The adolescent sample peat” 
adolescent subculture, The author seniors from Edsel Ford High School i in its 
sought to determine: (a) whether bOr, Michigan, was to be ps pia o rep” 

i A A : e 
adolescents differ significantly on be- aie ela 
havioral norm properties from adults society. 

? 

1 The present research was Conducted under Sub populations m 
the direction of A. Zander, Director of social , . 2. picko” ie 
esesreh ab the University ‘of Michie, and oe arah of a less 
H. Bretsch, Assistant Dean of the graduate are Doe teat T sas their Rie 
school at the University of Michigan. oh Hear e adults a a desirable t ci z 

The author gratefully acknowledges the side the SE it was aene maple for on 
help and encouragement of G, W. Allport of se types within the sa ý 


Harvard University. 
2 Now at the National Educatio 


n Associa- 
tion, Washington, D. C. 
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: : o! 
rate comparison to adults. Considerati 
given to the assertion that students 

recognized þ 
th 


an 
4 ers 

y classmates as being a athe" 

hose whose Personalities are ascenda! 
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beat ha aa would correspond more closely 
oe ts in their behavioral norms than non- 
on R or submissive adolescents. Leadership 
fe Lap ep are became the varia- 
peel selecting the adolescent subpopulations. 
ies 5 suei that the ascendant person may 
pe Boe er or a nonleader; similarly, a sub- 
Theres person may be a leader or a nonleader. 
io a each individual was to be assigned 
iade of four subpopulations, naniely: (a) 

r ascendant, (b) nonleader ascendant, 


(c Bae 
pe iaden submissive, or (d) nonleader sub- 


Desirability of Properties 


uo ee knowledge about agreement or 
in Sige oe is superficial if we cannot know 
adults a ans and under what conditions 
‘ fies adolescents agree or disagree. In 
a dence of some scheme for representing 
aie ee ofa norm, much of its potential 
realized či for analysis of groups fails to be 
called . However, using a statistical tool 
1960) tt return potential curve” (Jackson, 
he ide ne oe properties incorporated in 
urn a i norm” may be derived. The re- 
o M ohi, enables the investigator not only 

Facio the extent to which teachers and 

t als nis differ in their norms of behavior, 
each d (a) the limits of behavior which 
Where ee report they will approve or 
approval ig the intensity of approval or dis- 

beha t hey state is evoked by certain types 
Sivan Vior; (c) the proportion of the possi- 
own aur of behavior that would be in their 
ideal ree aa approved; (d) the point of 
e) fies cs as perceived by each group; and 
the aa relative degree of crystallization for 
š H of behavior of teachers and stu- 
Parison jea the investigation concerned com- 
norm of norm properties rather than merely 

S themselves. 


dent. 


B i 
Chavioral Areas 


; Subjects in the study were questioned on 
of fag of behavior. Norms examined were 
Gena basic types, namely, those which con- 
Prob pctent behaviors that teachers might 
beha ey have direct influence on and those 
Probyte over which teacher influence 1s 
hayo less direct. The more direct be- 
(b) OTS were (a) contradiction of teachers, 

rti lomework time, and (c) class discussion 
co, Cipation. The less direct areas of influence 
Vian tered were (a) dating, (b) clique de- 
Hoar and (c) physical education participa- 
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A scale of approval-disapproval feelings, 
ranging from numeral notation of 4 for strongly 
approving to —4 for strongly disapproving 
through a midpoint of indifference at 0, was 
provided the respondents for their judgment 
on the eight frequencies of the behavioral 
dimension for each question. A sample ques- 
tion from the investigation follows. 


Although there are no societal rules govern- 
ing the frequency of dating, students have 
ideas concerning how often they should 
date while in school. For example, students 
who date only once a year may find their 
dating behavior disapproved by some class- 
mates. On the other hand, students who 
date every evening may also be considered 
for disapproval by some classmates. If a 
student dates in the frequencies mentioned 
below, give your strength of approval or 
disapproval with the scale number of your 
choice in the column to the right. 


(a) Three times a year — 


(b) Once a month — 
(c) Twice a month — 
(d) Once a week — 
(e) Twice a week — 


(i) Three times a week — 
(g) Five times a week — 
(h) Daily = 


Major Instrument 


s of a norm are derived from 
l curve as shown in each 
The horizontal axis is the 
avior along which the fre- 
quency of action is cited while a dimension of 
evaluation is represented by the vertical axis. 
For any particular behavior dimension, the 
amount of approval or disapproval felt by 

toward a particular act 


members of a group 
may in principle fall anywhere along the 
evaluation dimension from strongly approving 


to strongly disapproving through some middle 
point of indifference. It is possible then in any 
concrete situation to plot a curve describing 
the feelings of the group members. Approved 
behavior would be revealed by positive po- 
tential return above the point of indifference 
whereas negative return characterizes be- 
havioral frequencies which are disapproved. 


The propertie: 
a return potentia 
of Figures 1-6. 
dimension of beh 


Determination of Subpopulation 
12 separate homerooms 


were administered a leadership indes. The 
names of all members of the particular home- 
room were listed and after each name appeared 


The seniors in their 


324 
TABLE 1 
NuMBER oF SUBJECTS IN Eacn Sus- 
POPULATION 
Group Men Women 
Ascendant leaders 48 $1 
Ascendant nonleaders 28 22 
Submissive leaders 39 14 
Submissive nonleaders 56 45 
Total 171 132 
a series of numerals from 1 to 5. Students 


were directed to circle the numeral after each 
student’s name which would indicate to what 
extent the rater considered the ratee to be a 
leader. The numeral 5 indicated that the rater 
believed the ratee to be outstanding in leader- 
ship whereas a rating of 1 indicated that the 
ratee was not a leader. After the subjects had 
been rated by their peers, the subjects’ leader- 
ship indexes were computed by multiplying the 
circled leadership numerals by the frequencies 
in which each number occurred and dividing 
this product by the number of students who 
did the rating. 

The Allports’ (1928) Ascendance Reaction 
Study was used to assess the relative ascend- 
ance or submission in the personality of the 
adolescent respondents. A fairly large number 
of situations is verbally presented in the reac- 
tion study in which the respondent selects one 
of a group of standardized responses which 
most nearly characterizes his usual behavior in 
that situation. Each response choice is con- 
sidered as having a diagnostic value for 
indicating ascendance (plus scores) or submis- 
sion (minus scores). The final ascendance- 
submission score is the algebraic sum of scores 
for separate items, 

From a frequency distribution the median 
score in the leadership index was chosen as the 
separation for leaders and nonleaders and the 
ascendance-submission scores exceeding O in a 
plus direction categorized the ascendant per- 
sons. Individuals were then Placed into one of 


the four subgroups depending on their scores, 
as shown in Table 1, 


RESULTS 


Before comparing the degree that 
various properties were assigned to the 
norms, it is useful to examine Figures 1- 
6, which contain the return potential 
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— feachera P 
r Hon-Leader Subatosive 
—Hon-Leader Ascon: 
Leader Subaissive 


— Loader ascendant 


TEN 


-i — 
sub- 

Fic. 1. Dating norm curve for ae i 
populations and teachers. (a. Three 4 


` onthi 
year; b. Once a month; c. Twice a Three 
d. Once a week; e. Twice a week; Daily.) 
times a week; g. Five times a week; h. 


Jl 
curves for all subpopulations 0? der 
questions, Note that the teachers oon 
much stronger approval than stu nge 
at the lower end of the frequency ™ ie 
and stronger disapproval at the greo 
frequency end of the behavior Una 
in all norms except that in Figu an 
(homework). In Figure 1 (dating) d 
Figure 5 (homework) teachers 
students seem to agree somewhat b 
Figure 4 (athletics), complete dis 
ment is evident. Throughout ac 
ures 1—6, it is seen that teachers eV! |-dis 
much stronger feelings of approva 
approval than do their students- esi 

Subsequent to surveying difference f 
return potential curve structures on 
tween teachers and students, the ©" yr 
parative properties were compute by 
teacher and student subpopulations ns, 
summation of feeling on all ques 


ut i” 
gree 
Fig 

e 
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Ms 2. Contradiction norm curve for all 
Pe ign and teachers. (a. Once a se- 
er; b. Once a month; c. Twice a month; 


- Three times a month; e. Once a week; 
ek; 


ie a week; g. Three times a we 
* Four times a week.) 


—— Teachers 
— => Ko dor Sutsiosive 


n: 
Z —— Son-Leader Ascendant 
Leader Suteisoive 
Tender Ascendant 


4 


pais. 3. Clique norm curve for all sub- 

b Pulations and teachers. (a. Once a years 

i ice a year; © Three times a year; 

f m Our times a year; © Once a month; 

a P a month; g. Once a week; h. Twice 
ek.) 
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— freachera 
— — — Kon-Leader Sutaiseive 
on-Leader Ascendant 

Leader Sutatscive 

Leader Ascendant 


ry 


Physical education participation 
ulations and teach- 
b. Once a month; 


c. Twice a month; d. Three times a month; 
e. Once a week; f. Twice a week; g. Three 
times a week; h. Four times a week.) 


Fic. 4. 
norm curve for all subpop 
ers. (a. Once a semester; 


hers 
Leader Subsiesive 
Tender Ascendant 
— Leader Sutaiosive 
Z Yeoder Ascendant 


a 


-4 
k norm curve for all sub- 
(a. 1 hour a week; 


Fic. 5. Homewor 


populations and teachers. 
b. 2 hours a week; c. 3 hours a week; 
e. 12 hours a week; f. 18 


d. 6 hours 2 week; 
hours a week; g. 24 ho 


a week.) 


urs a week; h. 30 hours 
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Fic. 6. Class discussion norm curves for all 
subpopulations and teachers. (a. Once a week; 
b. Twice a week; c. Once an hour; d. Twice an 
hour; e. 3 times an hour; f. 5 times an hour; 
g. 7 times an hour; h. 10 times an hour.) 


yielding a composite score which served 
as an index for the tests of significance. 
Index scores were used instead of one 
norm at a time as we assumed the ag- 
gregate score, representing a more gen- 
eral attitude about all norms among both 
students and teachers, was more rele- 
vant to our major interest than a de- 
tailed study of each separate norm. 


“Range of tolerability,” which is the 
part of a behavior dimension members 
of a group approve, was measured by 
taking the mean number of positive 
positions over the behavior dimension 
for all six norms as the tolerable score 
for each individual. Tolerable scores 
were then divided into categories me 
chi square comparison. Table 2 I 
that the range of tolerability for T 
dents does not differ significantly at t 
.05 level from that of the teachers. a 
there is no significant difference ben 
the boys and girls in their ranges 
tolerability. 

The intensity” of individual norm 
was measured by a summation of a 
ordinates at each position on the ‘i 
havioral dimension. Mean terei b 
each question was computed for ix 
group and then the mean of es 
norms, as shown in Table 3, was \ 
for comparison using the ¢ test Fat 
cedure. It is evident in Table 5 o1 
there is a significant difference at t nings 
level between the strength of fee th 
held by teachers and students er 
intensity of the norms. The H her 
intensity of boys was slightly on 
than that of girls but not significa 
50. o 

Table 4 shows a comparison een 
“approval-disapproval ratios” be orty 
teachers and students. This Lae is 
which indicates the extent behav! y 
sanctioned by a group, is compute 


TABLE 2 


RANGE or TOLERABLE BEHAVIOR FOR ALL NORMS—TEACHERS VERSUS STUDENTS 


Sample Tolerable Tolerable Tolerable Teachers its 
Score 1-3 Score 4-5 Score 6 -+ versus StU 
Teachers 5 22 3 ae A 
All students 135 135 33 aes 
Boys 73 75 23 65691 
Girls 62 60 10 4 


a All comparisons are nonsignificant. 
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TABLE 3 TABLE 4 
Mean Intensity ror ALL Norams—TEACHERS APPROVAL-DISAPPROVAL RATIO FOR ALL 
VERSUS STUDENTS NORMS— TEACHERS VERSUS STUDENTS 
t of difference M t of difference 
Sample 4 M for teachers Sample ratio for teachers 
intensity versus students i versus students ® 
Teachers 18.1 = Teachers 9 — 
All students 8.0 2.83* All students 13 1.61 
oys 8.0 3.02* Boys 1.2 1.46 
Girls 7.9 2.63* Girls 15 1.76 
*P<.01. 


dividing the mean intensity for positive 
return by the mean negative potential 
Over the entire behavior dimension. 
Mean ratios for each question were com- 
Puted.for each group and then the mean 

he six norms served as an index for 
comparison by £ test. No difference at 
= ‘OS level was found. The boys 
oo to sanction the behaviors less 
n the whole than did the girls but the 


oe was not statistically signifi- 


_ That behavior which represents the 
deal 


called. the eyes of group members is 
Shy the point of maximum return.” 
fon in of the mean maximal point 
whic ach student was determined after 
fa individuals were placed in one of 
Tahe for chi square comparison. 
class indicates that both the total 
and the boys were significantly dif- 

in point of maximum return from 


a All comparisons are nonsignificant. 


the teachers. However, the girls were 
not significantly different from the 
teachers. Thus, in the property of 
maximum return, girls appear to con- 
form more to the norms of teachers than 
do boys. 

The crystallization or, conversely, 
ambiguity of a norm, drawn from the 
variance of the return potential curve, 
indicates to what extent members of a 
group have really established a norm 
or made up their minds. The mean 
variance of each group was computed 
for each question after which the mean 
of the means was determined for com- 
parison by the F test method. In the 
cases of boys, girls, and the total class, 
Table 6 shows significance at the .01 
level for the degree of crystallization 
between student norms and those of 
teachers. 


At this juncture teachers were com- 


TABLE 5 
Maximum Return FOR ALL NorMS—TEACHERS VERSUS STUDENTS 
Sampi Maximum Maximum Maximum 3 j 
a Points Points Poi 
pe ed oints Teachers 

"i na E+ versus students 
aes i os — 

8 
Boys Udents 53 151 99 8.3600" 
Sing a Ee 56 9.2825% 

PS 305: j 


43 7.4375 


w& 
we 
œ% 


TABLE 6 


DEGREE OF CRYSTALLIZATION FOR ALL 
NorMs—TEAcHERS VERSUS STUDENTS 


F of difference 


M 
Sample fs for teachers 
variance versus students 

Teachers 5.0 — 
All students 13.3 2.66* 
Boys 14.1 2.82* 
Girls 12.5 2351* 

"Egoi 


pared to the subpopulations, and to the 
subgroups (separate sexes of subpopula- 
tions). Moreover, the subgroups were 
compared with each other. The meas- 
ures of comparison were the same as 
have been illustrated in Tables 2-6. 
Statistical differences for the properties 
of tolerable range and maximal point 
were found using the chi square method; 
intensity and approval-disapproval ratio 
differences determined by the ¢ test; 
and the degree of crystallization prop- 
erty compared by the F test. 

The major findings of this study show 
that high school seniors do differ signifi- 
cantly on certain properties in the norms 
of behavior from their teachers. The 
students as a group deviate from teacher 
behavioral norms on the Properties of 
intensity, maximum return, and degree 
of crystallization. Statistica] dissonance 
from teachers on the intensity property 
indicates that students do not feel as 
strongly about the behaviors studied 
as teachers do and therefore would not 
be as concerned about how their peers 
acted on these behaviors as would the 
teachers. The discrepancy in maximum 
return shows students and teachers differ 
in their perceptions of just what 
behavior is to be considered as ideal, 
indicating a behavioral goal conflict. 
Moreover, students do not have norms of 
behavior which are as crystallized or 
developed as norms of teachers, Thus, 
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on those behaviors studied the adoles- 
cents had not made up their minds to 
the extent that teachers had concerning 
what was to be approved or disapproved. 
On the other hand, the adolescents in 
their norm properties of tolerable = 
and approval-disapproval ratio were no 
statistically different from their teachers. 
These results seem to indicate that the 
restrictions as to what behavior will ge 
allowed or tolerated is nearly the Sate 
for adolescents as teachers. In addition, 
the proportion of possible range of ch 
havior that would be approved or dis 
approved by the adolescents is in oe 
with the ratio accepted by the teaei 
The answer as to why certain = 
crepancies exist between the proper to 
of teacher and student norms Oo ae 
be found by asserting that too ity: 
adolescents are ascendant in gerne 
Approximately half of the 5 ee 
sample was ascendant. Comparing t aik 
ascendant adolescents versus their ei- 
missive peers (ignoring sex and et 
ship) with teachers, it was found an 
ascendance does not seem to be rm 
important determinant on most Pate 
properties. Just as we cannot attrib" / 
the cause of statistical differences the 
tween adult-adolescent norms Pajah 
variable of ascendance, we cannot å rsu5 
the cause to leadership. Leaders oi 
nonleaders (ignoring sex and ascen an 
scores) were compared with teachers was 
the findings indicate that leadership wy 
not an important factor in determ” «j 
the extent to which adolescents i 
differ from teachers. Similarly, Eod 
versus boys (ignoring leadership the 
ascendance) were compared kii rtan 
result that sex was declared unimp° 
as a determinant. sub” 
The possibility that certain of the $ 
groups would be more like teacher i 
other subgroups led the investiga ou 
determine which of the eight ae be 
(including boys and girls) wou 


ADOLESCENT AND ADULT BEHAVIORAL NORMS 329 


most like and unlike teachers. The find- 
ings show that no one particular sub- 
group was in consistent agreement with 
teachers nor was any particular sub- 
&roup more unlike teachers than the 
others, 

Finding the extent to which subgroups 
differed from one another was important 
in determining whether one or more of 
the Subgroups deviated from their peers. 
With few exceptions, the uniformity of 
Subgroup norms would lead one to 
accept as reasonable the assertion that 
Students are mostly the same in their 

ehavioral norm properties. 

Of the three types of behavior in 
Which teacher influence was more likely 
9 Sccur, there appears to be no closer 
Proximity to adult norms than those 
Chaviors in which teacher influence is 
°3s likely, It would seem that direct 
et influence is of little importance 
a etermining the behavioral norms for 

'S Broup of senior students, 

Ome further interesting information 
thig os as concomitant outcomes of 
fos ee) Concerns the relative distribu- 
. ascendance and submission with- 

4 al adolescent subculture as well as 

ationship between ascendance and 
Data n. This study shows that if a 
Š Sei th leader the likelihood is twice 
that b lat he will be ascendant than 
ia a will not be. Conversely, if he 
t nleader, it seems twice as likely 
The e will be submissive as ascendant. 
sy misa ation between ascendance- 
{ Sion scores and leadership was 
( a 005) for senior boys and .37 

MOS) for senior girls, 


Discussion 


of cbis Study demonstrates the success 
of yoncthod by which the social climate 
With uth may be known. Adult concern 
Show, adolescent conformity may be 

© be valid or inappropriate de- 


pending on the direction of compliance 
and the types of behavior it may encom- 
pass. Nevertheless, to understand the 
ways in which peer pressures operate, 
to ascertain the areas of behavior in 
which these pressures are most in- 
fluential, and to seek ways by which 
such forces might be redirected for 
personal growth will be helpful in af- 
fecting an improvement of the educa- 
tive process. 

In terms of educational setting, we 
have always known what teachers expect 
of students; however, our knowledge is 
both recent and sparce concerning the 
nature and influence of student expecta- 
tions upon fellow pupils. Yet, educators 
readily admit that both the amount and 
kind of learning are influenced by 
student climate. Indeed, to avoid re- 
jection teenagers find it necessary to be 
cognizant of and in accord with peer 
norms regarding such academic behavior 
as class participation and allocation of 
homework time. No less expedient 
should it be for teachers to become 
acquainted with student norms lest they 
fail to offer an acceptable province for 
learning. 

Evaluating the teac 
has been a task of a 
for adults since time 
is now possible to 
desired outcomes of | 
relations and conduct 


hing of attitudes 
nxious dimension 
immemorial, It 
measure whether 
earning in human 
are being realized, 
ss a host of con- 
to racial tolerance, 


» and the 


ideas have been ac- 


cepted. 
Helping youn 


gsters maintain satisfac- 
tory relations w di 


ith their fellows is a dif- 
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ficult but necessary task of the educator. 
For the rejected child, something more 
than identification as an isolate is needed 
to produce adjustment. Comparing the 
deviant’s norms of behavior with his 
peer group will reveal the conditions 
under which exclusion occurs and enable 
the counselor to provide direction for 
the student. To best foster adjustment 
and to increase our knowledge of person- 
ality development we need to examine 
behavioral norms for children of all ages. 
This would involve consideration of sub- 
groups such as the creative and gifted. 
In the final analysis, a teacher’s effec- 
tiveness is adversely affected if his 
understanding of student norms is not 
in juxtaposition to reality. It follows 


that to better know the student is to be 
a better teacher. 
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ROLE OF DISCRIMINABILITY IN MEANINGFUL 
PARALLEL LEARNING 


DAVID P. AUSUBEL AND MOHAMED YOUSSEF 


Bureau of Educational Research, Uni 


Previously learned relevant background knowledge (Christi 
and retention of the Ist o 


l 


Subject matter in the classroom is 
requeñtly organized along parallel lines. 
hat is, related materials are presented 
It serial fashion, but there is no intrinsic 
Sequentia] dependence from one topic 
to the next, Unlike the case in sequen- 
tially organized subject matter, succes- 
Sive learning tasks are inherently in- 
“pendent of each other in the sense 

at Understanding of Part II material 
Part not presuppose understanding of 
IS loon Material, Each set of material 
adequacy self-contained and can be 
reference so By itself without any 
tion js - o the other; order of presenta- 
tio erefore Immaterial. This situa- 
tein Ok example, Prevails in presenting 
tiptoe theoretical positions in ethics, 
theori n, and epistemology; opposing 
fere es of iological evolution; and dif- 
ality Ps of learning and person- 

eory, 

by “Vertheless, although successive 
Parallelly organized 
trinsically dependent 
ch cognitive interac- 
curs between them, 
ements of a parallel 


n orienting and sub- 
ation to later Presented 


Seq ter learned el 
Sum OCE Serye a 
"NE role in rel 
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lst passage, but failed 
carning and retention of the 2nd passage. 


versity of Illinois 


anity) signifi- 
f 2 parallelly 
(Buddhism and Zen Buddhism) 


ae 


elements. The latter j 
and interpreted in 


understandings and paradigms provided 


by analogous, familiar, previously 


learned, and already established concepts 


in cognitive structure. Hence, for learn- 
ing of the unfamiliar new ideas to take 
place, they must be adequately dis- 
criminable from the established, familiar 
ideas; otherwise the new meanings are 
SO permeated with ambiguities, miscon- 
ceptions, and confusions 

tially or completely nonex 
own right. If, for ex 
cannot discrimin 


A’ and old idea does not really 
exist for him; it is Phenomenological]; 
the same idea as A. Furthermore. even 


S comprehended 
terms of existing 


idea 
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reduction is obviously accelerated if 
the new and unfamiliar concepts are 
indiscriminable from the old. If new 
ideas are not sufficiently discriminable 
from previously learned related ideas, 
they can be adequately represented by 
the latter for memorial purposes. 

In this experiment the two parallel 
and serially presented sets of unfamiliar 
ideas constituting the learning tasks are 
the principal tenets of Buddhism and 
Zen Buddhism, respectively. The prob- 
lem of discriminability for the learner 
arises first in differentiating the new 
Buddhism ideas from analogous estab- 
lished ideas about Christianity in his 
existing cognitive structure, and then in 
differentiating the Zen Buddhism ideas 
from the newly learned Buddhism ideas. 
The experimental subjects in each in- 
stance also receive the benefit of an 
advance organizer explicitly designed to 
increase discriminability by comparing 
the two sets of ideas in question at a 
high level of abstraction, generality, and 
inclusiveness, 

It is hypothesized, first, that the dis- 
criminability of new ideas from related 
previously learned ideas, and hence the 
efficiency with which they are learned 
and retained, is a function of the clarity 
and stability of the previously learned 
ideas. According to this hypothesis, the 
discriminability of the new Buddhism 
ideas depends upon the stability and 
clarity of the learner’s existing ideas 
about Christianity. If the Christianity 
ideas are vague, ambiguous, or confused, 
it is extremely difficult for the learner 
to differentiate the Buddhism ideas from 
them. Similarly, this hypothesis predicts 
that the discriminability of the Zen Bud- 
dhism ideas depends upon the stability 
and clarity of the analogous, 
learned Buddhism ideas, 

Second, it is hypothesized that an 
advance organizer increases the dis- 
criminability of new material 


newly 


from 


previously learned related material, and 
thereby enhances its learning and reten- 
tion, particularly in those subjects who 
either have less verbal ability or who 
find the new material less discriminablt 
because of the relative instability 
unclarity of the analogous, previously 
learned ideas in their cognitive structure. 


METHOD 
Subjects 


The experimental population consisted of 
162 predominantly senior undergraduates, a 
women and 67 men) in six sections aa 
educational psychology course at the Ea in 
sity of Illinois. All subjects were enroll? 

1 of 10 teacher education curricula a per 
secondary school level. The experimen n 0 
conducted separately in each section °% me 
quired laboratory exercise and was perto 
during regularly scheduled class pout a w 
order to maximize ego involvement, the were 
jects were informed that after the capt as 
Processed, their individual scores, as "hem 
the class results, would be reported to 


" p stri- 
Learning Passages, Measuring 1" 
ments, and Organizers 
his study 


The learning material used in y s00-word 


consisted of two specially prepared 2, epts ° 
passages dealing with the principal cone tivelY: 
Buddhism and Zen Buddhism, respeci” pe- 
The topic of Buddhism was chosen ponder” 
cause it was explicitly unfamiliar tO rallelly 
graduate students and because it was pa hris” 
related to previously learned ideas (i.¢» our 
tian doctrines) generally familiar to n well- 
subjects and, presumably, reasonab Zi most 
established in the cognitive structure ° jnc? 
of them. Both criteria were importer ots = 
the study was concerned with the © w ma 
discriminability between unfamiliar Loa The 
terial and previously learned related ide ose” 
Zen Buddhism material was similarly chip t 
because of its obvious parallel relation mili 
the Buddhism passage. The use as for all 
learning material also made it possible s 
subjects to start from approximately , 
baseline in learning the passages. miliarit” 
Empirical confirmation of the unfa ate! jal 
of the Buddhism and Zen Buddhism moaraple 
was obtained when a group of cae a 
subjects who had not studied the eas wer’ 
Sages, made scores which, on the averag® 
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only slightly and not significantly better than 
chance, 

Knowledge of the Buddhism material was 
tested by a 45-item multiple-choice test with 
a corrected split-half reliability of 80. Knowl- 
edge of the Zen Buddhism material was meas- 
ured by a 35-item multiple-choice test with a 
Corrected split-half reliability of .81. The 
Correlation between the two tests after study 
of the materials was .60. A 36-item multiple- 
Choice test with a corrected split-half reli- 
ability of .84 was used to test the subjects’ 
‘nowledge of Christianity. Items on this lat- 
ter test were noncontroversial, dealing with the 
Old and New Testaments, Church history, and 
denominational beliefs and differences. Scores 
on all tests showed a satisfactory range of 
Variability, and their distribution did not dif- 


er significantly from the normal distribution 
Curve, 


The ex 


perimental group studied two 500- 
Word 


i introductory Passages (comparative or- 
Banizers), the first pointing out the principal 
Similarities and differences between Buddhist 
fe Christian doctrines, and the second per- 
prming the same function for Buddhist and 
cn Buddhist doctrines. As a control treat- 
nae Procedure, the control group studied two 
t Nideational introductory Passages of a his- 
nrical and biographical nature about Bud- 
iti m and Zen Buddhism. No information was 
cuded in any of the introductory passages 
ques uld be of direct help in answering 
tests ‘ons on the Buddhism or Zen Buddhism 
Beralq n a previous study (Ausubel & Fitz- 
to ai 2 1961), by giving the Buddhism test 
the eel Control group which had studied 
dhi Omparative organizer without the Bud- 
ascertain ns Passage, it had been empirically 
Der eae that mere exposure to the organizer 
Vanta id not constitute an independent ad- 
the Re to the experimental group in taking 
Uddhism test, 
and Ca on the verbal portion of the School 
Verbal” “Be Ability Test (SCAT), reflective of 
ability, were available for all subjects. 


È 
"0cedure 


« 
jecte PE first day of experimentation, all sub- 
ook the Christianity test, and then 
assignment to a treatment group) 
Buda . either the comparative Christianity- 
trog ism Organizer or the control (historical) 
Ship i tory passage for 8 minutes. Member- 
mineg a given treatment group was deter- 
of each? random assignment. The population 
tratifieg of the treatment groups was also 
Y sex so that the Proportion of 
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men subjects to women subjects would be the 
same in each group. This was necessary be- 
cause of the women’s significantly higher 
Verbal SCAT scores. It was possible to ad- 
minister the two treatments simultaneously 
because they consisted of identical appearing 
introductory passages (with identical sets of 
directions), differing only in content. The 
principle of random assignment to treatment 
groups was relied upon to equate experimental 
and control groups with Tespect to relative 
learning ability and knowledge of Christianity. 
To equate the treatment groups with respect 
to prior exposure to the Buddhism and Zen 
Buddhism materials, those few subjects who 
had taken a course in comparative religion 
were divided equally in random fashion be- 
tween the two treatment groups. 

In order to control for the effects of class- 
room climate, instructor, and situational vari- 
ables in the six sections, students within each 
section were equally divided between the two 
treatment groups. Since homogeneity of vari- 
ance prevailed between treatment groups for 
the Christianity, Buddhism, and Zen Bud- 
dhism scores, it was considered justifiable to 
pool the scores from the various sections and 
to treat the scores from the two treatment 
groups on each of these instruments as com- 
parable random samples from the same large 
population, 

Two days after the first experimental ses- 
sion, on Day 3, both treatment groups re- 
studied their respective introductory passages 
for 5 minutes and then studied the Buddhism 
passage for 32 minutes. The test on the Bud- 
dhism passage came 48 hours later, on Day 5. 
Immediately after taking the Buddhism ‘test 
on Day 5, the experimental and contr 


They had another 
n Day 7, to study 
Ictory passages for 5 
y were given 30 min- 
u 

groups were tested on ed “ae 
1-week interval, on Day 14, 


RESULTS AND Discussion 


Effect of 


Backgroy 
Initial Par in 


allel Learni 


As hypothesized, 
relevant background 
tianity) haq a sign 
effect (pe -05) 


d Knowledge on 
ng 


previously learned 
knowledge (Chris- 
ificant facilitating 
on the learning and 
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retention of parallelly related Buddhism 
material (see Tables 1 and 2). Both 
experimental and control subjects in the 
upper part of the distribution of scores 
on the Christianity test made higher 
retention scores on the Buddhism test 
than did subjects in the lower part of the 
distribution of Christianity test scores. 
This facilitating effect of background 
knowledge was manifested when the in- 
fluence of verbal ability was statistically 
controlled in a covariance design. The 
stability and clarity of related back- 
ground knowledge therefore constituted 
a significant limiting condition with 
respect to learning the unfamiliar Bud- 
dhism material. It presumably did so by 
enhancing the discriminability of the 
new material. Similar findings were 
reported in a previous study (see 
Ausubel & Fitzgerald, 1961). 

Another possible interpretation of this 
finding that cannot be excluded by our 
experimental design is that higher scores 
on both the Christianity and Buddhism 
tests are a common reflection of either 
(a) greater general knowledge about 
religious terms and concepts, which gives 
the generally more knowledgeable sub- 
jects an advantage in understanding, 
organizing, learning, and retaining both 
Christianity and Buddhism material; or 
(b) greater general interest in religious 
subject matter, which provides the more 
interested subjects with greater motiva- 


TABLE 1 


Mean RETENTION Scores or EXPERIMENTAL 
AND CONTROL GROUPS oN BUDDHISM TEST 
ADJUSTED For SCAT SCORES AND ANALYZED 

BY CHRISTIANITY SCORE LEVELS 


Christianity Treatment group 
score levels Organizer Control 
Upper third 20.6 18.7 
Middle third 19.1 17.6 
Lower third 18.5 16.5 
Total 19.4 17.6 
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TABLE 2 


Covartance AxaLysıs or BuppaIsm TEST 
SCORES X CHRISTIANITY SCORE LEVELS, 
ADJUSTING FOR SCAT SCORES 


Adjusted 
Source SS ajf MS F 
+* 
Treatment’ 124.7 i 124.7 7.18 
Christianity sot 
score levels 121.6 2 60.8 i 
Interaction 5.3 2 2.6 “Sot 
Between 251.5 5 50.3 2. 
Within 2,691.7 155 174 
*p< 05. 
** p< .0l. ‘ 


tion to learn both bodies of religious 


knowledge. The discriminability hypo!” 
esis and these alternate explana’iov™ 
however, are not mutually exe : 
Furthermore, the discriminability dine 
pothesis is a more proximate interp" al 
tion of the finding than is the “ge? 
religious knowledge” hypothesis, 
it involves the influence of more © ite- 
related and pertinent background Mê 
rial. 

fer 
Effect of Initial Learning 0” Lat 
Parallel Learning 


sy Te 

Consistent with the above finding Sy. 
garding the effect of Christianity scores 
edge on Buddhism retention S% id- 
knowledge of the newly learned tated 
dhism material significantly facili tio? 
(b <.01) the learning and rete? tos 
of the Zen Buddhism passage (See pilitY 
3 and 4). That is, with verba! 7” 
statistically controlled, the subjects “ine 
made high, average, or low scores °% sor- 
Buddhism test tended to ma ghis 
responding scores on the Zen P affect 
test. However, the facilitating €; 
high stability and clarity of PreYY gis- 
learned related knowledge on ° yas 
criminability of the new materi? na” 
evidently greater in this instanc? ine 
in the preceding instance becaus® 
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TABLE 3 


Mean RETENTION SCORES OF EXPERIMENTAL 
AND CONTROL Groups ON ZEN BUDDHISM 
TEST, ADJUSTED FOR SCAT SCORES AND 
ANALYZED BY BUDDHISM SCORE LEVELS 


t 
Ge 
an 


TABLE 5 


Mean RETENTION SCORES OF EXPERIMENTAL 


AND ControLt Groups on Buppuism TEST, 
ApyusTED FOR CHRISTIANITY Test SCORES 
AND ANALYZED By SCAT LEvELS 


Buddhism Treatment group Treatment group _ 
scor levels Organizer Control SCAT level Organizer Control 
Upper third 17.4 16.9 Upper third 214 20.6 
Middle third 13.2 14.1 Middle third 18.7 16.5 
Lower third 13.1 11.6 Lower third 18.3 15.8 

Total 14.8 14.2 Total 19.4 17.6 


greater similarity between the Buddhism 
and Zen Buddhism material than be- 
tween the Christianity and Buddhism 
Material, The same alternate interpreta- 
tiors considered above also apply to this 
finding. 


Effect of Organizer on Initial Learning 


Analysis of covariance indicates that 

© organizer treatment facilitated the 
earning and retention of the Buddhism 
Passage. This effect was significant at 
the .01 level when verbal ability was 
held constant (see Table 2) and at the 
‘05 level when Christianity scores were 
eld constant (see Table 6). Contrary 
.© Our hypothesis and to previous find- 
'Ngs (Ausubel & Fitzgerald, 1961), how- 
ever, there was no significant interaction 


TABLE 4 


Q 
OVARIANCE ANALYSIS OF Zen BuppuisM TEST 
Scores x Buppnism SCORE LEVELS, 
ADJUSTING ror SCAT SCORES 


between Christianity scores and the 
organizer (see Table 2). The facilitat- 
ing effect of the organizer on Buddhism 
retention scores was apparently uniform 
over the entire range of Christianity 
scores (see Table 1) instead of being dif- 
ferentially more beneficial, as in the 
previously cited study, for those sub- 
jects who, according to our hypothesis, 
should have found the new material less 
discriminable because of the relative 
instability and unclarity of their Chris- 
tianity knowledge. 

Table 6 also shows that the interaction 
between the organizer and verbal ability 
was not statistically significant. Never- 
theless, as in a previous study (Ausubel 
& Fitzgerald, 1962), there was a sug- 
gestive trend for the organizer differen- 
tially to benefit the lower ability sub- 


TABLE 6 


COVARIANCE ANALYSIS oF BUDDHISM TEST 
Scores X 


SCAT LEVELS, ADJUSTING 


FOR CHRISTIANITY SCORES 
Adjusted SS 
Source = a F Source eo ae 5 
baiment 2s a as a Treatment 164 111.6 7 
feet «48572 NGA aoe Dmt AL 2 BTA mope 
maa SA2 Sima dme Wao 0S3 Soane Tase 

363. 5 15.3 26186 155 16.9 

Pa -rga 
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jects; the only significant difference 
(p<.05) between organizer and control 
groups occurred in the lower-third sub- 
group of subjects on SCAT (see Table 
5). Presumably the subjects of average 
and better ability are more capable of 
spontaneously discriminating between 
new ideas and previously learned related 
ideas, and hence derive less benefit from 
an advance organizer designed to 
enhance such discriminability. 


Effect of Organizer on Later Leaning 


Unlike its effect on the Buddhism 
retention scores, the organizer did not 
significantly facilitate the learning and 
retention of the Zen Buddhism passage 
(see Table 4). This negative finding 
possibly reflected the fact that since the 
recently learned and tested Buddhism 


material was still relatively fresh in mind 
while the Zen Buddhism passage was 
being learned, the ideas in the two sets 
of material could be readily enough dis- 
criminated without the benefit of the 
organizer, especially by subjects with 
an average or better knowledge of Bud- 
dhism. Contrary to our hypothesis,'also, 
there was no significant interaction be- 
tween the organizer and level of Bud- 
dhism knowledge (see Table 4). 
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BYPASSING AS A WAY 


OF ADAPTING SELF 


INSTRUCTION PROGRAMS TO INDIVIDUAL 
DIFFERENCES! 
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ute for 


A self-instruction program on set the 
bypass form allow 
a consequence of correct res 
lincar form permitte: 
š only the basic steps. 
1 of the 3 learning methods and 
day. Test score and learning 


ponses to 
d no bypassin 


time 


groups -and lowest for the short groups. 


corresponded closely 
was thus no more effi 

matical ability level. 
Encountered casually, individual dif- 
erences in Personality and behavior are 
© Spice of life. But to the educator or 
qa chologist who confronts them on 
wt E are a force to be reckoned 
în S n trying to cause the same change 
Brou any persons, or a difference between 
| di PS he often finds that individual 
Variances remain the largest source of 
thi ce in the outcome. Nowhere has 
een more evident than in school- 
earning, Ability testing, now al- 
niversal in schools, is based on the 
lce ti idual differences 


Ost y 
remi 


Wil that these indiy 


Persist 


thie Present research is also based on 
ascot mise. Our purpose has been to 

am whether programed self-in- 
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ory was prepared in 3 forms. The 
ed S to skip up to 85% of the learning material as 


15 required basic steps. The long 


g and the short linear form presented 
780 Ss in 4th-12th grade cl: 


assrooms were assigned 


given a test of amount learned the next 


means were highest for the long 


Amount learned and time spent 


to number of program pages studied. Bypassing 
cient than the linear methods, regardless of mathe- 


struction might be improved by varying 
the instructional sequence so as to ad- 
just to individual differences among 
learners. Early pilot studies (Campbell, 
1961) failed to demonstrate the practi- 
cality of employing parallel linear pro- 
grams as a means for adjusting to indi- 
vidual differences, when variations in 
directness of cueing and mode of re- 
sponding are the distinguishing features 
of parallel programs. 

A reasonable altern 
linear progr, 
ing, 


ative to parallel 
ams is some form of bypass- 
that is, a branching program in 
which everyone is Presented the mini- 
mum set of basic steps, and individuals 
who fail a given step immediately take a 


remedial “loop” of instruction on that 
step. One bypassing 
offer a large numb 


Sequence which em- 
articular weak Points and 
spent in places where he 

acumen or prior knowl- 


The appropriatene: 
a given learning topi 
tent of individual q 
of instruction neede 


SS of bypassing for 
c depends on the ex- 
ifferences in amount 
d at each Step. Given 
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an appropriate topic, the success of by- 
passing should depend mainly on two 
things: the validity of each decision 
which directs the learner either to begin 
a remedial loop or to bypass it, and the 
effectiveness of the remedial instruction 
contained in the loops. In other words, 
one must accurately evaluate the learn- 
er’s progress and also know what to do 
if his learning is inadequate. 

The principle of “adaptive” instruc- 
tion is not unique to programing, of 
course. The same paradigm underlies 
all educational plans in which instruc- 
tion is intended to be geared to the 
learner’s progress. Aside from careful 
attention to sequencing of material and 
the fact that the instructor’s help is not 
needed to adjust the procedure to the 
student’s progress, the main feature dis- 
tinguishing self-instruction programs is 
the greater frequency of the learner’s 
responses through which his progress 
can be evaluated. The study of bypass- 
ing programs thus lends new perspective 
to the larger and older problem of re- 
medial instruction in general. Remedial 
instruction is intended to be adaptive to 
the learner’s progress, by definition. But 
incisive studies of its two main require- 
ments, validity of evaluation and effec- 
tiveness of remedial learning, seem pe- 
culiarly rare in the literature (Curr & 
Gourlay, 1953). Perhaps this is because 
it seems obvious that extra instruction 
where the learner has failed will be bene- 
ficial. We set out to prove this truism in 
the realm of programed instruction and 
were taken aback by the fin 
ported here. 

In earlier studies of branching pro- 
grams (Campbell, 1961; Coulson & 
Silberman, 1960; Silberman, Coulson, 
Melaragno, & Estavan, 1960) bypassing 
and nonbypassing yielded equivalent 
criterion test score means, but in some 
of these experiments bypassing saved 
time and in others it did not. Because 


dings re- 


Vincent N. 


CaMPBELL 


of the mixed findings of prior a? 
our main experiment was preceded by 
series of pilot studies aimed at refining 
the experimental program eae: 
hypotheses about key characteristics 
bypassing. 


MENTAL , 
DEVELOPMENT OF THE EXPERIMEN 


PROGRAM 


r ‘ art 
The learning topic chosen was 4 p of 


of set theory. The main objective dae 
the program were grasp of the a to 
mental concepts presented and abi xh “3 
use these concepts to rnake tensi T 
in both directions between symbole <e 
pressions and concrete situations. ac- 
criterion test items used to ae 
complishment of the learning © e no 
were heterogeneous in form and we 


those used in the program itself. isis 


to writing the basic steps requi"? 
all learners as to the remedi teach 
Finding that a well-written loop A 
more than a poorly written bas! ma 
would be of little interest. T top! 
writing guide, beyond having kw and 
well in mind, was to keep it as € in 
interesting as we could and tried t° 
simplest language possible. We rder © 
keep the basic steps concise in © aved 
maximize the time that might a 
through bypassing. The remedia 
were changed and lengthened $ 
tially during revision. form € 
At no time did we try to COM? amt 
a particular school or style of Pener® í 
ing. In view of the mixed and A 0 
negative findings on the impo inst 
particular features of programe yj pel 
tion (e.g., Briggs, Goldbeck, Chase 
& Nichols, 1962: Lumsdaine 


the form pragmatically on th 
several group experiments in © 


jasst0%, 
(fourth to twelfth grades) and } 


pte” 
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tape recorded interviews with individual 
subjects. Aside from specific changes in 
content intended to make the instruction 
more effective, the major characteristics 
of the program which emerged as a 
result of these developmental studies 
and a review of related literature are 
listed helow as principles: 


l. Make the learner’s response to 
€ach basic step a valid indicator of his 
learning Progress, however difficult a re- 
Sponse this may require. 

2. Avoid failures early in the remedial 
loop (Valentine, 1951). Application of 

1s principle took the form of requiring 
no responses at all, or only easy ones, in 
the first 2 or 3 pages of the loop. 

3. Make a special point of discrimi- 
nating “and contrasting easily confused 
Ideas and symbols, e.g., intersection (N ) 
and union (U), 

4. In teaching complex combinations, 

egin at an elementary level and take a 
Slow Part-by-part approach, only grad- 
ally combining the simpler ideas into 
a whole (Gagné, 1962). 
ik Series of illustrations and examples 
© more effective for learning concepts 
for Principles than are abstract or 
fis Statements during initial learn- 


(Haslerud & Meyers, 1958; Hen- 


drix, 1946), 


T final version of the sets program 


ià Š Prepared in a bypassing form and 


Sid oe linear forms. The bypass form 
of Hg long linear form each consisted 


Called 7X84 inch pages, of which 65 
Cry, for one or more responses. The 
back answer always appeared on the 
Wag ie the same page. The program 
i lvided into 15 booklets correspond- 
oft the 15 basic steps. The first page 
con NY booklet was the basic step, which 

ded by calling for a response. The 
bootie! loop made up the rest of each 
the €t- The loop was required work in 


Ong linear form, but was bypassable 


clu 


in the bypass form. The short linear 
form of the program consisted of the 15 
basic step pages stapled together in a 
single booklet, the remedial loops being 
entirely excluded. 


Criterion for Bypassing 


The format of the bypass program 
was the same as the long linear one 
except that on the back of every basic 
step page beside the correct answer was 
printed this instruction: “If your answer 
was right, skip to the next booklet zow.” 
Where two or more answers were called 
for, the subject was instructed to skip 
only if all were correct. Midway 
through four of the longest loops the 
subject was given a second chance to 
bypass the rest of the loop in this man- 
ner. 

Besides correctness of the learner's 
response, another potentially important 
criterion for bypassing is the learner’s 
own judgment as to how well he has 
learned. We compared these modes of 
evaluation with the sets program in three 
eighth grade classes. In addition to a 
group bypassing on the basis of response 
correctness, another group bypassed 
each remedial loop only if they both 
answered correctly and “understood the 
page.” Since program responses were ap- 
parently easier than posttest items, and 
since “understanding” might be sub- 
jective enough to be swayed by motiva- 
tion, we thought it more promising to 
require both understanding and response 
correctness than to make understanding 
alone sufficient for bypassing, > 


There was no difference between the 


two groups in mean test score, nor in 
mean learning time, The new 
criterion had no apparent adva: 
had the disadvantage of being 
plicated, so we used only res 
rectness in the main experim 


bypassing 
ntage and 
more com- 
ponse cor- 
ent. 
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A common observation is that initial 
incomprehension of something mathe- 
matical often induces panic, indifference, 
hostility, or some other unreceptive state 
of mind, which in many people becomes 
a permanent attitude toward mathe- 
matics. Since each new idea in the sets 
program was introduced through a 
concise basic step and a question difficult 
enough to be a valid index of learning, it 
seemed worthwhile to investigate the 
possibility that failing the basic step 
might hinder subsequent learning from 
the remedial loop. 

In order to test this hypothesis we pre- 
pared “reversed” long programs in which 
each remedial loop was studied before 
its basic step rather than after it. We 
then compared groups who took this 
reversed long linear method with groups 
who took the long linear program in its 
normal order (basic step, then loop). 
Both methods presented the same learn- 
ing materials, but the reversed long 
method led the student gradually from 
the simple to the difficult, hopefully 
thereby avoiding adverse effects of im- 
mediate failure on that segment. The 
two methods were compared in two 
fourth grade and two eighth grade 
classes. There were no appreciable dif- 
ferences between the two methods in test 
score or learning time at either grade 
level. Apparently the basic step did not 
detract from remedial learning with the 
sets program. 

Details of the studies on effects of 
evaluation, bypassing criteria, and pro- 
gram development jn general are 
reported elsewhere (Campbell, 1962). 


METHOD 


Subjects 


A total of 780 public school si 


tudents from 
the San Francisco Peninsula arı 


ea served as 
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subjects for the main experiment on bn i 
The classes chosen were essentially pen 
tive samples of students from these particu A 
schools and grade levels as nearly as we ie $ 
judge by administrative criteria and abili x 
scores. The breakdown by grade level ni 
school was as follows: the entire fourth e 
(n = 166) and sixth grade (n = 173) a 
lations of two schools, 150 cighth graders a 

a third school, and, from one high school, t 
tenth graders and 139 twelfth graders. 


Design 


The effectiveness of bypassing with ien 
program was judged by comparing cri the 
test scores and time spent learning HOE ich 
three learning methods (program forms), W 
are summarized below: sect 

1. Bypass: After each basic step the is 
skipped to the next basic step if He con- 
was right. If his answer was wrong tae in- 
tinued on through the remedial loon " 
struction. à 

2. Short (linear): The program an g 
remedial loops. The subject worked t 
the 15 basic steps in linear fashion. yorked 

3. Long (linear): The subject aE þasic 
straight through the entire program Ortunity 
steps and remedial loops with no opp? 
to skip any of the loops. 


dno 


Procedure tase 
rade clas 
In each fourth, sixth, and cighth grade assy 
the subjects were assigned cither the assing 
long, or short form of the program bye same 
out the three forms in alternation. In t abjects 
manner the tenth and twelfth grade ne or 
were assigned either the bypass progr ethod 
the short program. The long linear Jes be- 
was omitted for the high school samp classes 
cause of the difficulty of rescheduling 
to permit sufficient time, of ever 
The instructions on the front page Ea the 
program briefly explained the er (a8 
sets lesson and emphasized the educa, sercis 5 
opposed to testing) purpose of the “e ypa% 
therein. Bypassing was explained te most 
subjects only) as a way “to spend et” 
time on the ideas that you find har ogra 
All subjects in a class began their Pis 
at the same time and each worked a the few 
pace until he had finished, except =A jn the 
(about 8%) who did not quite finish i 
maximum time available. The latter 9 iy 
were included in all data analyses.. , 
recesses were taken in the fourth, Pa i 
cighth grades. Time spent on the prog! 
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recorded for each subject. One third of the 
twelfth grade sample was kept especially quiet 
throughout learning to assess the effects of 
noise on learning. It had been observed that 
„Doise increases toward the end of a class 
period, and that this might differentially affect 
the learning methods. 

„ The sets criterion test was given the follow- 
ing day at the same hour. Nearly all subjects 
spent between 10 and 20 minutes on the test, 
but there was no time limit. 


RESULTS 


At all grade levels bypass group cri- 
terion test means surpassed short group 
Means and weie lower than long group 
means (Grades 4, 6, and 8). Likewise, 
Mean learning times for bypass groups 
fell between those of the short and long 
lineas groups. Figure 1 shows mean test 
Score as a function of mean learning time 
for, each method at each grade level. At 


any given grade level the points for the 


Short and long methods may be thought 
of as two points on a curve representing 
amount learned as a function of length 
Of a linear program covering a fixed set 
of objectives. It is difficult to estimate 
exactly where the interpolated point 
Would fall on such a curve for a linear 


25 
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B=Bypass method 
L=Long method 
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program of intermediate length requir- 
ing about the same time to complete as 
the bypass program. But judging by the 
general shape of learning curves of this 
type, a medium length linear program 
would teach at least as much as the by- 
pass program if not more. 

In order to detect ability effects, each 
grade in the sample was divided into 
three approximately equal sized ability 
groups on the basis of available mathe- 
matical ability scores. The California 
Achievement Test (CAT) Total Arith- 
metic score was used in the fourth and 
sixth grades; and the Differential Apti- 
tude Test (DAT) Numerical score in 
the eighth, tenth, and twelfth grades. 
Mean criterion test scores and learning 
times for each method at each grade and 
ability level are shown in Tables 1 and 
2. Test score and learning time variances 


TABLE 1 


Sets Test Means ror EACH LEARNING 
METHOD, GRADE, AND ABILITY LEVEL 


Learning method 


Grade Ability Short Bypass Long 
Twelfth 
High 27.1 26.3 
Medium 17.9 16.9 
Low 11.8 12.9 
Tenth 
High 20.6 23.7 
Medium 11.5 1 
Low 10.0 mi 
Eighth 
High 17.9 20.7 24.3 
Medium 10.3 14.6 15.7 
Low 7.5 118 11.5 
Sixth 
High 9.4 10.1 12.0 
Medium 54 7.6 9.5 
Low 4.3 3.8 6.0 
Fourth 
High 78 6.5 7.9 
Medium 4.7 5.3 6.7 
Low a1 19 3.2 


. Note.—n per entry varies from 12 to 28. Estimated 
SD within methods is approximately 5.0. 
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TABLE 2 


Lrearninc Trae Means (in MINuTEsS) AnD 
STANDARD DEVIATIONS For EACH LEARNING 
METHOD, GRADE, AND ÅBILITY LEVEL 


Learning method 
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were then analyzed with ability group 
as an independent variable, which re- 
quired correcting for disproportionate 
Ns. Since only two learning methods 
were used in the high school, two over- 
lapping analyses of variance were per 
formed for each dependent variable. 


Sioe aS _ Eog Both aríalyses included all three ability 
Grade Ability M SD M SD M SD groups, but one analysis compared the 
short and bypass methods across all sy 
Taek High J 5 pp grade levels while the second ana a 
Medium 23 5 33 8 compared all three learning methods ia 
Low 26 5 39 7 the fourth, sixth, and eighth grades. a: 
Tenth summaries of these analyses are sho” 
cin es 7 = ; in Table 3 for sets test scores 4” 
Table 4 for learning times. 
Low 26 5 34 9 +a: ation at 
Eighth These analyses gave no indica Sig 
High 24 3 38 § 66 11 all that the effectiveness of by?*® j 
Medium 25 5 46 13 76 15 relative to the linear methods che 
HON 235 5 57 15 71 19 asa function of the student’s leve 
Sixth th tical abili There was 2 slig: 
High a oe swa mig A mateatabiity: ih ability 
Medium 27 5 60 16 68 16 tendency (p<.05) for hig wilt 
Low 30 10 58 17 77 14 students to finish the program Sely 
Fourth but this difference was almost €” ho 
A = 9 62 23 78 22 accounted for by the bypass me ple 
eas 3 v 4 = “ alone. It makes sense that the more ots 
students would tend to make fewer © 
TABLE 3 
ANALYSES OF VARIANCE oF SETS CRITERION TEST SCORES 
Short versus bypass All learning methods 
(all grades) (fourth, sixth, and eighth grades) 
Source df MS F a MS F 
Grade (G) 4 3630 6ee* 
Ability (A) 2 3008 : pen pone 
Method (M) 1 175 2 373 16.3*** 
oo 8 4 156 7.0" 
GXM 4 77 4 83 3.7** 
AxM 2 o Es oy 
GxAxM 8 to — 4 o p 
Within 489 33 s 3 
Total 518 ba 22 
*p< 05 
a 


01. 
*F* p < 001. 
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TABLE 4 


ANALYSES OF VARIANCE OF LEARNING TIMES 


Short versus bypass 
(all grades) 


All learning methods 
(fourth, sixth, and eighth grades) 


Source df MS F df MS F 
Grade (G) 4 10728 2 6873 26.5*** 
Ability (A) 2 1396 2 257 — 
Method (M) 1 57036 2 78301 301.4%** 
GxA s 91 — 4 480 1.9 
GxM 4 2913 18.6*** 4 530 2.0 
AxM 2 609 3.9* 4 474 1.8 
GxAxM 8 147 — 8 339 13 
Within 489 157 427 260 

Total 518 453 


Note.—Within-group variances were 


heterogeneous but no useful transformation of 


learning times was apparent. This may add an increment of doubt to marginally significant 


effects such as the A X M interactions. 
. 


p < .05. 
se p< 001. 


and thus bypass oftener and finish 
Sooner. Bypass subjects at higher grade 
levels should also have finished sooner 
for this reason, which appears to account 
for most of the Grade x Method inter- 
action indicated in Table 4. Although 
relative learning efficiency of the bypass, 
ong, and short methods did not depend 
3Dpreciably on ability level, there were 
Substantial differences between ability 
€vels in amount learned for all methods. 
ere. were also marked differences be- 
Ween grade levels in amount learned, 
Ut learning time differences between 
Brades were very slight for the linear 

Methods from the sixth grade up. 
‘Omparison of sets test means for the 
Rc versus “quiet” rooms in the 
Velfth grade sample showed no sign at 
< Of greater learning in the quiet room, 
€r for the group as a whole or for 
Bs bypass group relative to the short 
ne > Apparently social distraction was 
amo a notable factor in determining 
oh learned. This result corrob- 
whic those of earlier pilot studies in 
by “1 We tried to avoid social distraction 
an, 8iving the subjects who finished early 

€r task to keep them occupied. 


t, 


DISCUSSION 


As a way of adapting self-instruction 
to individual differences in order to in- 
crease learning efficiency, bypassing did 
not manifestly succeed with the sets pro- 
gram. Even in the eighth grade where 
the remedial loops taught the most (see 
Figure 1), learning was no more efficient 
when the loops were required only after 
errors (bypass) than when they were re- 
quired after all basic steps (long). 
Number of program pages studied, or 
average study time required, seemed to 
account for most of the variance in 
amount learned among the bypass, short 
linear, and long linear methods. An 
interesting question unanswered by the 
present research is whether studying the 
remedial loops would have been any 
more effective than repetition of the 
basic steps for an equivalent amount of 
time. 

Since the remedial loops were of some 
benefit regardless of how they were as- 
signed, it is appropriate to ask whether 
the fault lay in the basic step evalua- 
tions of learning progress. It is difficult 
to determine separately the validity of 
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each evaluational response in the pro- 
gram, because there was not a one-to- 
one relationship between program items 
and test items. But since the program as 
a whole was meant to cover the same ob- 
jectives as the test, the correlation be- 
tween total errors on the short linear 
program and total test errors is a gross 
index of the validity of the evaluational 
responses as indexes of learning pro- 
gress. The program-test correlations 
were in the vicinity of .50 for the eighth, 
tenth, and twelfth grades, indicating a 
substantial degree of validity. 

Apart from the fact that program 
questions and test items are small “in- 
dependent” samples of a very large 
population of behaviors indicating 
knowledge about sets, there are other 
sources of attenuation in these validity 
coefficients. The correlation between 
total test score and total program score 
glosses over differences among subjects 
as to which particular steps were failed, 
however validly such differences are 
diagnosed. Another source of attenua- 
tion is the effect of feedback (answers) 
following the basic step responses. 

The program-test correlations were so 
small as to be negligible for the fourth 
and sixth grades. The younger students 
may not have understood or accepted 
the bypassing procedure as easily as 
older students. For example, about 20% 
of all bypassing decisions were in error 
(e.g., bypassing after a Wrong response) 
and a disproportionate number of these 
occurred at the lower grade levels. This 
may also explain why the fourth and 
sixth grade bypass groups learned even 
less efficiently than might have been ex- 
pected of a linear group taking the same 
time. 

There were fewer wrong answers pro- 
portionally on the program than on the 
criterion test, which suggests another 
factor that may have limited the y 


alidity 
of the program score and the use: 


fulness 


Vincent N. CAMPBELL 


of bypassing. Perhaps the basic = 
were demanding enough to wpe 
momentary grasp of the idea, but | k- 
not require enough practice and T 
ing through to insure 24-hour reten ily 
and transfer to new problems, especta. 
in an area as unfamiliar as set gee 
was to most of these subjects. if 
were the case, bypassing might pin 
siderably more useful as a review a 
nique to be used after initial ee a 
has created a wider span of indivi in- 
differences in knowledge. Sinta i 
creasing severalfold the amount 0 din 
and remedial instruction containe ram 
each of the 15 steps of the sets a i 
might have enhanced the efficien 
bypassing. stain 

Unfamiliarity with the niee 
technique, as well as the conten in th 
have worked against a cae nal in 
present studies. A more longitud! ing Í 
vestigation of the use of bypas iee in 
needed to determine whether pi P more 
the use of bypassing would make ! 
valuable. ay as 

One reason for choosing set theo aps 
an experimental topic was that t dent. It 
are somewhat sequentially depen! nedial 
seemed that the on-the-spot Te?” jf- 
instruction provided by bypass!” 
instruction programs would bera 
beneficial for such a hierarchica factor 
There may be other relevant eat” 
which would enable one to ee able 
ing topics and objectives more aon tha 
to bypassing in initial instruct! i 
was set theory. step 

One such variable may be the forent 
to which different learners fail joped * 
steps within a topic. We deve? 962) 
statistical index (Campbell, < opro" 
similar to Guttman’s coefficient juan 
ducibility (Green, 1954) which Ve © 
tively expresses this interdepe? jearni9l 
difficulty of various parts of 4 ers: we 
topic for a given sample of sane eat 
applied the index to data from 


Sial y 
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version of the sets program and a pro- 
gram on the United Nations. The results 
indicated greater individual differences 
in relative difficulty of the steps in the 
United Nations program, suggesting a 
possible advantage over set theory in the 
use of bypassing. 

On this basis we conducted prelimi- 
nary studies (Campbell, 1962) compar- 
ing bypassing and short linear forms of 
the United Nations program. In eighth 
` Grade and twelfth grade classes bypass 
8roups learned more than short linear 
8toups but took.,considerably more time 
in learning. The results resembled those 
with the sets program in the present high 
School sample. In both cases further 
research is needed to determine whether 
bypassing is more efficient than giving 
all subjects the remedial loops in linear 
format. 

If bypassing has any value for any 
topic, either for initial learning or re- 
View, it has yet to be shown. Perhaps 
the generally accepted rationale for 
adaptive and remedial instruction de- 
Serves critical reappraisal. In any case 
the problem cannot practically be 
Ignored. There are core subject matters 
'N which we want all students to learn 
the fundamentals. Branching and by- 
Passing in self-instruction programs 
may not prove to be effective for any 
oven One, but the problem of how those 
vho fail initially can learn to a minimum 
“titerion of mastery will remain. 
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STUDENT TEACHER C 
THE PUPILS 


HARACTERISTICS FROM 
’ VIEWPOINT! 


DONALD J. VELDMAN AND ROBERT F. PECK 
University of Texas 


Five factors were extracted from evaluations of 554 student teachers on 


the 38-item Pupil Observation Survey: 


II. Poised, Knowledgeable; III. Int 
and V. Democratic Procedure. Inv: 


I. Friendly, Cheerful, Admired; 
eresting, Preferred; IV. Strict Control; 
ariance of factor structure was demon- 


strated across 3 semester subsamples and across teacher-sex, and factor- 


score reliabilities were computed. 


Female teachers were higher than 


males on Dimensions I and V. Correlations with 2 attitude inventories 
were low, but significant. Relationships of factor-scores to supervisor- 
rated effectiveness were linear and positive for Factors I, IJ, and IV, 
except for a curvilinear effect with males on Factor I. a 


The description and evaluation of 
teacher behavior continues to be a 
central problem in educational research 
(Barr, Worcester, Abell, Beecher, Jensen, 
Peronto, Ringness, & Schmid, 1961), 
and a recent book by Sarason, Davidson, 
and Blatt (1962) focuses particular at- 
tention on the evaluation of teacher 
preparation programs. Many schemes 
have been devised for converting subjec- 
tive impressions derived from classroom 
observation into quantified statements. 
The present study describes the develop- 
ment of an instrument designed to re- 
duce the everyday observations of pupils 
to reliable measures of important aspects 
of teacher behavior, 

One major diffculty often en- 
countered in assessment operations of 
this kind has been the choice of dimen- 
sions to represent the most relevant 
aspects of teaching performance. Some 
investigators have resorted to a simple 
summation of ratings on separate scales 
in an attempt to obtain a stable criterion 


1 This research is a part of the Mental 
Health in Teacher Education Project, College 
of Education, University of Texas, supported 
by Grant No. 2M-6635 from the Training 
Branch, National Institute of Mental Health. 
Portions of this paper were presented at the 
meetings of the American Educational Re- 
search Association, Chicago, February 1963, 


ha 
measure (Dalton, 1962). A 


strong general factor usually Oat? 
among scales which attempt to 13°% į 
aspects of teaching effectiveness, than 
sometimes possible to extract more aries 
one meaningful dimension from } factor 
of such judgements. Cluster ant joye 
analytic methods have been eMP™ tor 
occasionally for this purpoe fous 
instance, Ryans’ (1960) very i three 
research monograph describes m be 
major factors of teacher-classro c ive 
havior which emerged from an T b- 
investigation of ratings by tral? teach- 
servers previously experienced iN 

ing: 

Pattern Xo: understanding, 
versus aloof, egocentric, 
teacher behavior 

Pattern Yo: responsible, 
systematic versus evading, U"P 
slipshod teacher behavior «native? 

Pattern Zo: stimulating, imag” dull, 
surgent, or enthusiastic versus 
routine teacher behavior 


rest! 


businesslike 
Janne’? 


the 
> r5 
In contrast to Ryans’ observe!™ y a5 


pupils in the classroom are untrain€ ind 

raters and, of course, have nO -i 

experience. One of the wea p 

inherent in most studies invol jm! 

use of trained observers is the 
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sample of actually observed behaviors 
upon which the assessments must be 
based. Adequate evaluation demands an 
adequate sample of observed perform- 
ance in the wide variety of roles 
demanded of the modern teacher. A 
single hour of classroom observation 
` Seldom“ provides sufficient evidence for 
an observer to evaluate the full range 
of attributes of interest to investigators. 
No one would seriously argue that the 
Pupils taught by a teacher are inevitably 
the best judges of her effectiveness or 
ability. Nevertheless, the pupils have 
One major advantage over other ob- 
_ Servers: they see the teacher perform on 
Many different occasions, as she en- 
Counters a wide variety of problems, as 
She att(mpts quite varied tasks, and as 
She deals with individuals known per- 
Sonally to the observer. Not only does 
tach pupil have the advantage of many 
Separate observations upon which to base 
his judgement, the use of pupils as ob- 
| Servers also affords the increased reli- 
; ability and reduction of bias that 
multiple judges afford. The validity of 
Pupil observations remains to be dem- 
Snstrated, but there are strong a priori 
Feasons to expect higher reliability from 
this method than from procedures em- 
Ploying single observers. 
In the assessment program of the 
ental Health in Teacher Education 
Yoject at the University of Texas a 
Umber of different observation methods 
a been used in attempting to gather 
™Mprehensive pictures of student 
| teher behavior. One of the techniques 
eloped by the project staff is a 
} tioy OMnaire called the Pupil Observa- 
Sem Survey (POSR). During three 
a this form was completed 
taughe po by each of the pupils 
in the 4 y each of the student teachers 
Austi Junior and senior high schools of 
tern n, Texas. The present paper con- 
the dimensions of student teacher 
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behavior which emerged from analyses 
of these data. Item means for each 
teacher were factor analyzed, and factor 
scores were computed for each student 
teacher. The nature and stability of the 
factor dimensions, their reliability as 
scaled scores, and preliminary validity 
evidence will be reported. 


METHOD 


The POSR is a 38-item questionnaire pre- 
senting a 4-point scale of agreement after each 
statement. Many „of the items were adapted 
from an earlier experimental form (McClain, 
1961; McClain & Bown, 1961). All statements 
are phrased positively and attempt to measure 
pupils’ reactions, as well as behavioral char- 
acteristics of the student teacher. Separate 
forms, differing only in the relevant pronouns, 
were prepared for male and female student 
teachers. The instructions on the face sheet 
of the form were as follows: 


To The Student: 

The College of Education at the Univer- 
sity of Texas is studying several ways of 
preparing student teachers. The University 
wants to know how you have felt about 
working with your student teacher this 
semester. Your answers to these questions 
will be used for research only, and will 
have nothing to do with the grade your 
student teacher gets. When you answer the 
questions on the next pages, it is important 
to mark the way you really feel. 

After you read each question, put a circle 
around one of the four letters that follow 
each statement. If you think the statement 
is completely true, circle the capital T. If 
you think the statement is more true than 
it is false, put a circle around the small t. 
If you think the statement is more false 
than it is true, circle the small f. If you 
think the statement is completely f i 
the capital F. j 

Here is an example: 


alse, circle 


My student teacher has a loud voice. 
i TEEF 
If you think she has a very loud voice, you 
would circle the big T: @tir 
If her voice is a little louder than most 
people, circle the small t: TOf F 
If her voice is a little softer tħan most 
people, circle the small f: T tOF 
If her voice is very soft, you would circle 
the big F: Tti® 
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When you finish the second page of ques- 
tions, please go back and make sure that you 
did not accidentally skip any of them. Please 

ji l of the questions. 
answer all o —- 


The forms were administered to three semes- 
ter subsamples, a total of 554 student teachers, 
by their public school cooperating teachers 
after the students had completed their re- 
quired teaching sequences. Only classes from 
the seventh through twelfth grades were used. 
Considerable effort was expended to communi- 
cate to the pupils the fact that the evaluations 
would be utilized solely for research purposes, 
and very few cooperating teachers or student 
teachers refused to allow-the forms to be 
administered. 

A series of studies was carried out with 
these data in order to establish the usefulness 
of this method of obtaining descriptions of 
student teacher performance. 

1. Factor analysis of POSR items. The 
circled choices on each pupil’s protocol were 
punched on cards as scores on a 4-point scale. 
These item scores were reduced to item means 
for each student teacher through the use of a 
computer program which excluded unanswered 
items in the computation of the 38 means. 
The items were treated as “tests” and sub- 
jected to factor analysis,? using all student 
teacher means as data. 

2. Factorial invariance. The three semester 
subsamples were independently factor analyzed 
in order to obtain evidence regarding invari- 
ance of factor structure over subject popula- 
tions. All male teachers and all female teachers 
were also utilized in separate factor analyses. 


A factor matching Procedure (Ahmavaara, 


1954) was used to compare the factor struc- 
tures from the three 


semester subsamples, as 
well as those derived from male and female 
teachers. 


3. Factor score reliabilit 
computed for each stud 
dimension as it emerged 
of POSR items with the 
teachers with the largest 
and item means and fa 
computed separately for 
vided half of each tea 
factor scores were then 
reliability estimates for tl 


y. Factor scores were 
ent teacher, on each 
in the factor analysis 
total sample. The 50 
classes were selected, 
ctor scores were re- 
each randomly di- 
cher’s class. These 
correlated to yield 
he factor scores, 

2 Principal-axis factor anal 
ties in the diagonal of the 
trix, was used througho 
factors with eigen values 
were selected for rotation 
varimax technique. 


i lysis, utilizing uni- 
intercorrelation ma- 
ut this study. All 
greater than unity 
by the normalized 
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' 
4. Sex differences on factor dimensions. m ' 
factor scores for male and female e | 
were compared by single classification an: | 
of variance on each factor dimension. joi 
5. Correlations with attitude e aa in 
The factor dimensions were used as So iat 
computing zero-order and multiple oor peychO- 
from the 18 scales of the come an’ 
logical Inventory (CPI; Gough, 1 entory * 
10 scores from the Self-Report invi 
SRI; Bown, 1961). A r of 
: 6. Validation against supervisor aae al | 
effectiveness. Ratings of the sae super- 
the student teachers by their Griva n 
vising professors were used as a cri f strong 
each factor dimension. Because o on tbe 
central tendencies among the aiok extreme 
various scales used, and “secause O ‘super 
variations in central tendency amo the | 
visors in their use of the rime sara ‘orm ' 
ratings on individual scales of the Š semeste! 
were averaged (15 items for the coe divi 
subsample). These means were t a student 
into approximately equal groups iddle, "4 
teachers for each supervisor: high, MOC” 
low rated. 


RESULTS 
Factor Analysis of POSR Items 


Table 1 contains the factor So 
of the 38 POSR items from [ht 
analysis of all 554 student teache pele 

The first factor was tentatively ‘seems 
Friendly, Cheerful, Admired eae Xo, 
to be very much like Ryans’ Pat q facto 
at a descriptive level. The secon ed an 
was called Knowledgeable, Po!5 ased 
seems to describe self-confident mate 
on thorough understanding of iot w 
rial to be taught. The third faet ap” 
labeled Interesting, Preferred Z0 The 
pears to match Ryans’ Pattern ful pre” 
item content reflects lively, skillfU a ger 
entation of materials as well a5 s jth 
eralized preference for rene ed. 
these qualities. The fourth factor „ps 
Strict Control, seems to resemb i 
Pattern Yo more’than any of t 
factors. These items coul 
domineering behavior, but coul p 
flect a serious well-organized G ively 
to teaching. The fifth factor, te? 


cture í 
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TABLE 1 


Factor Structure or POSR ITEMS ror ALL 554 STUDENT TEACHERS 


Item Loading 


L Friendly, Cheerful, Admired 
26. She is always friendly toward her students 


-90 

38. She is good-natured and easy to get along with S87 
18. She never seems to order her students around 85 
29. She always seems cheerful and happy SS 
9. She usually looks on the bright side of things n 84 
19. She smiles most of the time Si 
16. You can tell<that she really likes her students .78 
37. She is always interested in hearing a student’s ideas 35 
13. You can depend on her to be fair with you 74 
35. She is as interested in her students as she is in her subject 74 
! 6. She seems to understand the problems students have 74 
30. Iswould like to have her as a personal friend 73 
1. She is admired by most of her students 67 
21. She sets a good example for her students 65 


| S. She hardly ever gets flustered about anything that happens 64 
11. I would like to be like her in some ways 


57 
u, Knowledgeable, Poised 
17. She knows a great deal about her subject .85 
| 34. She doesn’t get confused by unexpected questions T7 
27. She must have studied hard to know so much about her subject .73 
| 7. She is never stumped by a student’s question 12 
36. She seems to know more about her subject than just what is in the book 69 
15. She always seems sure of herself in front of the class 69 
33. She always seems to know just what she'll do next 63 
ne She doesn’t seem to be afraid of making mistakes 53 
u, Interesting, Preferred 
ie — makes learning seem more like fun than work 76 
Y he is the best teacher I have ever had -73 
a Her class is never dull or boring .72 
| 25° I wish all my teachers were like her 71 
12 F knows how to put her subject across in a lively way .70 
24 has made her subject alive and interesting for me 70 
| 4 he doesn’t try to cover the lesson too fast 61 
ly * She explains her assignments clearly and completely 57 
| 3p tet Control 
|3, She doesn’t let her students get away with anything 86 
23. $ e expects a lot from her students and usually gets it "5 
i 14, Students respect her because she means what she says 66 
KA © doesn’t let the class discussion get too far off the subject 37 
« g Mocratic Procedure 


| ag Before she decides on a new project, she often asks the st 
a k : j udents what i 
i She likes to give the students a choice of how to do an assignment ai hink pi 
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labeled Democratic Procedure, is loaded 
heavily by only two items, which have 
in common the teacher’s active solicita- 
tion of the help of the pupils in making 
decisions about the goals and procedures 
to be chosen. 


Factorial Invariance 


Table 2 presents the results of the 
factor matching analyses of the three 
semester subsamples. Since the invari- 
ance was so strong across these factor 
structures, only the coefficients for cor- 
responding factors are shown in Table 2. 
The results of the factor matching of 
male and female student teachers’ factor 
structures are shown in Table 3. 

Factors I, II, and IV in both analyses 
appear to be highly similar. The two 
large coefficients for Female Factor III 
appear to be the result of a splitting of 
this factor into two components in the 
males’ analysis. The items thus sepa- 
rated are those appearing in Table 1 as 
general Factor V (Democratic Proce- 
dure), an independent dimension which 
did not emerge in the females’ analysis. 
For female teachers the two items re- 
flecting willingness to allow pupils to 
take part in decisions about goals and 
methods appear as part of the dimension 
registering the pupils’ liking for the 
teachers who are lively and interesting. 
This aspect of teacher behavior con- 
stitutes an independent dimension for 
male teachers, however, and is by defini- 


TABLE 2 


FACTORIAL EQUIVALENCE AMONG THREE 
SEMESTER SUBSAMPLES (S) 


Factor Sı versus S2 Si versus Sa Sz versus Sa 
I .99 .99 08 
I 99 99 ‘98 
iit 96 98 98 
IV 199: 98 97 
y i 92 99 
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TABLE 3 


Factor Matcuinc COEFFICIENTS FOR CoM- 
PARISON OF Factor STRUCTURES FOR MALE 
(N = 111) ann Femare (N = 443) 
STUDENT TEACHERS 


Females $ — 

Males ` I I I 
12 
I 99 06 03 o2 
II 07 98 20 os 
Ill 14 33 90 09 
IV 01 05 10 “i 
y -06 30 93 ‘30 
VI 18 33 an 


he 
tion not systematically related tt al 
third factor. Factor VI in soe er 4 
analysis appears to be the oe class 
single item (14: “He doesn’t let ject”) 
discussion get too far off the su Ak V, 
which splits off from Female Baes oí 
Why this item should be a symP d not 
strict class control for one sex ae for 
the other is not apparent. eel the 
the minor variations noted abov' i 
factor structures obtained separato sost 
the two sexes appear to be 
identical. 


Factor Score Reliability 


ient’ 

The “split-class” reliability coef res 
calculated for each of the facto and 
were: I. 92, IT. .72, IIT. .91, IV. $ Y cor 
V. .89. These coefficients were a for 
rected with the Spearman-Brow y the 
mula for half-length tests since ptaininé 
largest classes were used m E ities 2 
these coefficients. These reliabili use o 
pear high enough to warrant te jiditY 
the factor scores in subsequent 
studies. 


' + aS 
; mensi’ 
Sex Differences on Factor Dime r 


. ults oe 
Table 4 contains the E i 
analyses of variance compan! z ma 
factor scores of male an 


i 


| 
| 


í 
r 
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TABLE 4 
TEACHER-SEX DIFFERENCES 1x POSR FACTOR Scorrs 
Factor Male M Female M F 
1. Friendly, Cheerful, Admired 47.05 50.74 12.28** 
JI. Knowledgeable, Poised 49.75 50.06 OS 
II, Interesting, Preferred 51.15 49.71 1.83 
IV. Strict Control 49.44 50.14 B 
V. Democratic Procedure 48.25 50.44 4.28* 
N 111 443 
> 05. 
SESE 
teachers. The highly significant dif- Correlations with Attitude Inventories 


ference for thë first factor (Friendly, 
Cheerful, Admired) and the significant 
difference for the fifth factor appear to 
e consistent with role expectations in 
our culture; women are commonly con- 
Sidered to be more warm, exuberant, 
and. permissive in their relationships with 
children. 


Futher information regarding the 
nature of POSR factors is provided by 
the correlations of CPI and SRI scales 
with each of the factor dimensions, sepa- 
rately for the male and female student 
teachers. These Coefficients, as well as 
the multiple correlations and correspond- 
ing F ratios, are located in Table 5 and 6, 


TABLE 5 
ZERO-ORDER AND MULTIPLE CORRELATIONS or 18 CPI Scares wit Eacu POSR Factor 
= - == — - 
CPI Males Females 
Scale We e = g a Se 
I II Il IV Vv I Il Tl IV v 
È 1* 13% os à a og 
Sy 11* o9* 03 01 Os 
Sp è 14* * 03 10* 04 04 
Ni 11*  09* 11* 02 06 
Wp 07 06 14** oz 07 
Ra 08 -03 —oọol =04 ~ 2 
So os 06 ~11* 9 12% 
Se 0s ~o1 0 —07 -ol 
To 04-06 -o7 _ 06 00 
Gi 10¥ ož o <9 Os 
Ch 09* 00 00 —o09* 04 
Ag —03 —03 08 —02 _os 
Aj —18 08 07 10* 04 03 02 
Te —09 13 02 —01 = T5** -o 08 
by — 08 12 Se: ee —02 02 
R =i 07 =p _o9 —10* ol 06 
e 16 —14 OF at —12** 03 10% 
R E oS 06 68 e ae 
P 399 398 1S 308 305 219 227 
NX -92 .91 2.48** 2 298% 5 214% 4. $ 
2.2 2.34 ja ia | 1.23 
2 poo Males N= 106; females N = 424. 
P Lio. 
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TABLE 6 


‘ACTORS 
ZeRO-ORDER AND MULTIPLE CORRELATIONS OF 10 SRI Scores with Eacan or THE POSR F. 


Males 


Females = 
SRI score I um wv vy I uo m wo Y 
2 
Self -07 —06 02 o8 —o1 10* 00 08 — g = i 
Others —10 ol 0 -—15 —09 08 —02 7" — o 
Children —11 —04 14 —02 =17 07 —o4 04 0 o0 
Authority —11 22* 09 o5 —07 12* 03 02 00 _6s 
Work —10 24* 07 02 07 He 0 o6 —05 E 
Reality —07 14 ol —21 08 19** o1 11* OF = 
Parents 06 03 03 05 00 09 04 1 — a = ae 
Hope —14 13 12 —07 —14 o5 —o05 16% —02 o 
Total —12 12° 11 —02 =07 15** 00 15** —05 03 
Ratio 03 00 o5 —03 16 — 07 o1 os 08 J02 
R -209 397 171 244 293 .209 .100 237 185 39 
F 34 140 23 AT 70 1.68 ay 2a 130 See 


* 


Note.—Males N = 86; females N = 379, 
05. 
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Of the 180 correlations computed 
with CPI scales, 34 exceed the 5% level 
of confidence. On the other hand, none 
of the coefficients exceeds .30 in absolute 
magnitude. For SRI scores, 13 of the 
100 coefficients exceed the 5% level, but 
none are larger than .24. There appear 
to be some minor relationships between 
these paper-and-pencil inventories and 
the behavioral evaluations by the pupils, 
but they are quite indistinct at best. 
In terms of multiple correlations, the 
results are equally unimpressive. For 
males, only Factor IV was reliably pre- 
dicted by CPI scales, while none of the 
factors could be predicted by SRI scores. 
For females, Factors I, II, and III were 
reliably predicted by CPI, but only 
Factor III could be Predicted by SRI. 

The first POSR factor (Friendly, 
Cheerful, Admired) is related only to 
CPI Dominance scale in a negative direc- 
tion for males. For females it is related 
positively to CPI Sociability and nega- 
tively to Psychological-mindedness, It 
is also related positively to SRI Total 
and Reality scales. These relatively 
strong correlations suggest that, at least 


s 
for females, the first POSR factor ra 
indeed reflect a comfortable, ann 
ceptance of life and an interest Pa an 
people on a social as opposed factor 
intellectual level. For males this ality 
may involve a quite different aes 
pattern, since 15 of the 18 scales © rse 
and 9 of the 10 SRI scores show a in 
signs on the correlation ceme oe 
comparing males with females. Alt this 
the evidence is only suggestive; lize 
factor appears to reflect a gene dent 
timid uncertainty among male stu 
teachers, e- 
The second POSR factor (Knowledges 
able, Poised) was related to TOUP tl 
reflecting a stable orientation it was 
work, among males. For females. ace, 
most strongly related to CPI Sani 
and also to scales reflecting a a 
achieve within a traditional au 
structure. ing: 
The third POSR factor (Inter e 
Preferred) is most strongly aoe 
what might appear to be depen the 
intellectual attitudes for both san jeve- 
correlations were negative with Ach ical- 
ment via Independence, Psycholog 


STUDENT TEACHER CHARACTERISTICS 353 


mindedness, and Flexibility. For females 
only, this factor was also related posi- 
tively to CPI Self-acceptance and SRI 
Total, Hope (for the future), and Others 
scales. Pupils appear to prefer teachers 
who are lively and interesting, and these 
Deople would seem to be characteristi- 
cally nonrebellious and positively ac- 
cepting of life as they find it. 

The fourth POSR factor (Strict Con- 
trol) yielded results suggesting that, 
when considered apart from the levels on 
the other POSR factors, this dimension 
reflects characteristics most psycholo- 
gists would évaluate negatively. For 
males the negative correlations with CPI 
Achievement via Independence, Intel- 
lectual Efficiency, and Psychological- 
mindedness seem to reflect a syndrome 
of anti-intellectual attitudes. For fe- 
males the negative correlation with SRI 
Parents, combined with negative correla- 
tions with CPI Good Impression and 
Femininity, may well indicate an etio- 
logical clue to a syndrome of “bitter- 
ness.” 


The implication here is that negative 
attitudes toward parents, combined with 
insensitivity and self-centeredness (sug- 
gested by low Femininity and Good im- 
pression scores), produce behavior in a 
teaching role which is seen by pupils as 
rather harshly overcontrolling. Further 
research is needed to confirm these re- 
lationships in other samples, however. 

The fifth POSR factor (Democratic 
Procedure) was unrelated to any of the 
scales for males, but was positively 
related to CPI Responsibility and, 
understandabiy, to Flexibility for fe- 
males. One might speculate that this 
factor reflects the attempts of some 
student teachers to conscientiously apply 
democratic principles in managing their 
classes, 

Validation against supervisor ratings 
of effectiveness. In Table 7 are located 
the comparisons between supervisor rat- 
ings and POSR factor scores. Means on 
each POSR factor are included for each 
sex, at each of the three levels of teach- 
ing effectiveness, as determined by the 


TABLE 7 


Anatyses or POSR Factor Scores AT THREE LEVELS or TEACHING EFFECTIVENESS (E) as 
DEFINED BY SUPERVISOR RATINGS 


a 


Male student teachers 


POSR factor High E M Average E M LowE M F 
L Friendly, Cheerful, Admired 43.66 50.47 44.50 4.36% 
TL. Knowledgeable, Poised 52.84 50.16 46.62 3.16* 
"I, Interesting, Preferred 49.57 51.26 49.37 23 
IV, Strict Control 55.65 47.90 45.05 6.69%* 
V. Democratic Procedure 49.43 49.18 48.39 07 
N 24 29 34 
Female student teachers 
r Friendly, Cheerful, Admired 53.48 51.48 47.27 13.68** 
lg. Knowledgeable, Poised 52.77 49.57 47.74 8.43% 
Ww Interesting, Preferred 50.65 49.57 48.71 1.30 
y Strict Control 51.56 50.05 48.35 3.66* 
*“emocratic Procedure 51.15 51.43 49.41 1.78 
& 127 151 132 


z 
$ <05. 
“por. 
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ratings made by supervising professors. 

For both male and female student 
teachers, supervisor ratings of effective- 
ness are a function of the same three fac- 
tors: I. Friendly, Cheerful, Admired; 
II. Knowledgeable, Poised; and IV. 
Strict Control. Except for the males on 
Factor I, all of these relationships ap- 
pear to be linear and positive. 

In contrast to the females for whom 
greater friendliness is related to a higher 
effectiveness rating, the male student 
teachers who receive the highest scores 
on friendliness are thdse rated as 
mediocre in effectiveness. It will be re- 
called that this first factor also yielded 
a series of negative correlations with 
various attitude scales for males, but 
positive correlations for females. Evi- 
dently a high rating on Factor I implies 
quite a different pattern of other 
qualities for the two sexes. For females 
it is associated with social confidence 
and effective teaching, while for males 
it is found among somewhat timid in- 
dividuals of mediocre effectiveness, 


Discussion 


The cliché that you get out of a factor 
analysis somewhat less than you put 
into it probably holds in the case of the 
present investigation, Nevertheless, the 
factor dimensions defined here do have 
certain properties which give them con- 
siderable promise for further research 
with teacher candidates, either as cri- 
teria or as predictors. Their internal 
consistency is, in one sense, guaranteed 
by the manner in which they were 
defined, while their invariance over sub- 
ject populations and pupil subclasses has 
been adequately demonstrated. 

As pointed out by Stern (1963), strik- 
ingly similar factors have emerged from 
a number of independent analyses of 
student ratings. He concluded that “the 
verbalized teacher image is a widely 
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shared and extremely stable stereo- 
type.” Empathy (friendly, democratic 
behavior) and competence (systematic, 
organized behavior) were mentioned as 
the essential components of this idealized 
image. In the present analysis five in- 
dependent aspects of teacher behavior 


were identified; Factors I and V might ' 


fall under the “empathy” heading, while 
Factors II and IV would appear to be 
related to “competence.” Factor 
(Interesting, Preferred), however, prob- 
ably corresponds more clearly with the 
pupil’s notion of “effective teaching 
than any of the other factors. 

As was described earlier in the present 
report, there appears to be a close CO 
respondence between each of Ryans 
three patterns and one or another af the 
POSR factors. This would seem to CO" 
firm the hypothesis that pupils can P!0” 
vide at least as much information regar®” 
ing teacher characteristics as can expert 
adult judges on the basis of 1 or 2 hou" 
of observation. There are a number os 
indications in the present study, how 
ever, of the need for a thorough study 
of the relationships between the v4 T 
systems of adolescent judges and adu 
experts regarding teacher characteristics: 

The most striking result of the or 
parisons of supervisor rated effectiven® 
and POSR factors was the total lack °° 
relationship between supervisor evalue” 
tions and Factor III: Interesting: 
ferred. It seems quite apparent at 
the item content shown in Table ! aa 
this factor reflects the pupils’ ideas ,- 
an effective teacher. The supervis! 
ratings, on the other hand, are q" t- 
clearly a function of the stud 
teacher’s friendliness (I), poise ( It 
and control of the classroom (IV): r- 
is also interesting to,note the lack oio 
respondence between Factor V oe 
ocratic Procedure) and the effective" Te 
ratings. Inspection of the means fo "hat 
three groups suggests the hypothes!S 


_~ 
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autocratic behavior may be related to 
poor teaching, but lends little support to 
the idea that democratic methods are a 
necessary part of effective teaching be- 
havior—at least as supervising profes- 
sors see it. This hypothesis deserves 
more definitive testing in future research. 

The reasons for the low predictive 
validity of the attitude inventories used 
in this study also deserve concern in 
further research. Self-report question- 
naires simply may not provide a sufñ- 
cient degree of differentiation to yield 
anything but slight indications of rel- 
evant personality traits, due to restric- 
tion of range of these attributes in the 
present samples. It should be remem- 
bered that all of the subjects in the 
Present study were college seniors who 
eventually graduated and were certified 
as competent teachers. 

A number of other questions remain 
to be answered regarding possibly im- 
portant sources of variation in POSR 
factor scores, Among these potential in- 
fluences are the interactions of pupil and 
teacher sex (Velman & Peck, in press), 
the social class level of the school in 
which the teaching was done, the grade 
level of the pupils, and particularly the 
interaction of teacher and pupil person- 
ality characteristics (Heil, Powell, & Fei- 
er, 1960), There is no reason why 
actor scores need be computed only 
Tom the item means for teachers. Dif- 
erences jn viewpoint among the mem- 

ers of a given class may also be revealed 
Y separate computation of scores on the 


ve dimensions, from each pupil’s pro- 
tocol, 
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LEARNING UNDER CONDITIONS OF DIRECT AND 


VICARIOUS REINFORCEMENT ' 
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Arizona State University 


This study is concerned with the 
tingencies on the learning of the E 


AND 


ROBERT M. W. TRAVERS 
University of Utah 


effect of various reinforcing con- 
nglish equivalents for 60 German ea 


words. This task was administered in a situatién involving groups of 
8 Ss and a “teacher” E. In addition, 2 learning conditions, with Ss 


learning in isolation, involved the use 
situation 3 different relationships to 


of teaching machines. In the group 
the reinforcement were introduced. 


Ss who made no overt response, but simply observed, learned reliably 
less than Ss in the same group who learned with overt responses followed 


by a reinforcing event. 


The classroom is rarely a suitable 
place for conducting studies which may 
contribute to an understanding of the 
learning process, for the events which 
occur within it include many uncon- 
trolled conditions which may mask the 
particular effects in which the experi- 
menter is interested. On the other hand, 
research conducted within the laboratory 
is undertaken under conditions so differ- 
ent from those of the classroom that one 
is hardly justified in applying knowledge 
derived from such experimentation to 
the solution of problems of classroom 
learning. Laws of learning discovered 
under typical laboratory conditions have 
boundary conditions, and one cannot as- 
sume that learning in the classroom falls 
within these boundaries unless this has 
been demonstrated. What appears to be 
needed for the solution of educational 
problems is research conducted in situa- 
tions which retain all the desirable 
features of laboratory experimentation, 
but which also simulate certain charac- 
teristics of the classroom. The results 
of such studies can be generalized to 
classroom settings with much less fear 
that the generalization is unwarranted, 


1 This research was supported by Office of 
Education Research Contract OE No, 2-10-010 
to R. M. W. Travers. 
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Laboratory research involving a 
tions related to classroom learning pace 
appear to be needed particularly at t i 
time in the area of reinforcement learo 
ing, for experimental psychologists a 
shown a proneness to generalize wae 
results derived from the study of ie 
human subjects in highly contro $ 
laboratory situations to the solution a 
problems of teaching children in scho 
rooms. 

The central part of the study rep! 
here is an attempt to investigate in 
effect of certain classes of reinforcers n- 
a situation in which a high degree of Sa 
trol can be exercised over the poese 
tion of stimuli related to learning, She 
response conditions, and the reinforc! é 
contingencies. The study is ag 
on the phenomenon which has been al 
ferred to by Osgood (1956) Ta 
deCharms and Rosenbaum (1960) is 
vicarious learning. Vicarious ian 
defined as learning occurring in 
“observer” organism which has the La 
portunity of watching another me™ in 
of the same species. Proponents of *© y 
forcement learning theory have gee be 
taken the position that learning wil the 
most effective if the learner makes © ie 
full response to be learned and is e 
forced for it and that such learning wt 
be greatly superior to that of an obser¥ 


orted 


à who makes no overt response and for 


whom there can be no clearly identifiable 
reinforcement contingent on the re- 
sponse. A number of investigations with 
infrahuman subjects, such as those by 
Miller and Dollard (1941), Angermeier, 
Schaul, and James (1959), Darby and 
` ` Riopele (1959), and Hayes and Hayes 
` (1952), have demonstrated the existence 
of vicarious learning at various phyloge- 
netic levels. Other studies such as those 
of Kounin and Gump (1958), Lewis and 
Duncan (1958), Rosenbaum (1962), 
and Rosenblith (1959) have examined 
the vicarious l¢carning in humans. 
The typical classroom recitation situa- 


i, tion is one in which the teacher antici- 


| 


IN «ment. 


in 


pates that vicarious learning will take 
placez- Recitation involves the following 
pattern of pupil-teacher interaction: 

4, The teacher addresses a question to 
‘Pupil X. 

2. The pupil gives an answer. 

3. The teacher provides a reinforce- 


The procedure generally involves the 
assumption that, as a result of this inter- 


¿`> action, other pupils not included in it, 


| 


Y 


4 


2 fully ang 


but proximate to the respondant, will 
also learn and to about the same extent 
as Pypil X. The validity of the latter 
assumption is examined in this research. 
In addition, data are provided com- 
Paring the performance of the directly 
` reinforced pupil with the performance 
d of pupils learning under another condi- 
tion which has been widely advocated 
as being particularly effective by rein- 
forcement theorists. This is the learning 
condition provided by a teaching 
WN machine which is claimed to provide con- 
` ditions for learning superior to those 
provided by the classroom recitation 
procedure in that the subject responds 
overtly to each situation pre- 
aid reinforcing events are pro- 
Ontingent on each response, 


Sented 
vided c 
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However, since the teaching machine 
provides reinforcement through a 
mechanical arrangement, another ques- 
tion raised is whether human reinforc- 
ing agents have properties which me- 
chanical reinforcing agents do not have. 
Hence, the study makes some provision 
for studying this question. 

Finally, there is the possibility to be 
explored that an occasional pupil-teacher 
interaction may maintain the overall 
learning of the pupil at a higher level 
than it would be without such an inter- 
mittent exchange. 


METHOD 
Task 


The first step which had to be undertaken 
in the development of this study was the con- 
struction of a learning task which (a) could 
be administered in a learning situation con- 
forming to the response-reinforcement learn- 
ing model, (b) was similar to learning tasks 
commonly observed in classrooms, (c) was 
such that it could be administered under 
several different learning and reinforcement 
conditions, and (d) would permit a reliable 
measure of learning. The task selected was 
that of learning and meaning of 60 German 
words. 

The learning task consisted of a German 
stimulus word which in the experiment was 
to be correctly associated with one of two 
English noun responses. German was selected 
because it was assumed that there would be 
few children with any familiarity with this 
language, and in addition, that interest in 
learning foreign words would be high. 

The general format of the task required a 
subject to guess which one of two English 
words meant the same as a given German 
word. Reinforcement followed the response, 
These pairs of English nouns (one of which 
was the equivalent of the German stimulus) 
had to be selected so that one could assume 
that they had equal association to the German 
stimulus. In providing a pool of such words 
all nouns of three to eight letters in length 
(not having some obvious association with the 
German word) were taken from the Thorn- 
dike-Lorge (1944, Appendix, Part V) list of 
Original Thorndike Words, The pairs were 
selected separately for the first 500 most fre- 
quently occurring and for the second 500 most 
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frequently occurring words. An additional 7 
were taken from the list of 110 appended to 
the original 1,000, which yielded a total of 
314 words from which the task could be as- 
sembled. 

On the basis of an argument advanced by 
Underwood and Schulz (1960), a second step 
in providing for equal association value was 
the assignment of a numerical frequency value 
for the first bigram of each selected word, i.e., 
(AP)PLE. In the pairing of response choices 
the bigrams of the two words had to have 
approximately comparable frequencies (as de- 
termined by the compilers, Underwood and 
Schultz). 

In addition to the procedures already out- 
lined, each English noun was checked for level 
of readability to insure that words used were 
well within the reading capacity of the partici- 
pating subjects. Durrell (1956), in his Ap- 
pendix A of Improving Reading Instruction, 
lists 754 words compiled at the primary grade 
level as vocabulary for older children in 
remedial reading programs. Each word has 
been assigned a value ranging from 1 to 7 
which indicates frequency of occurrence in the 
literature of small children. It was found that 
69% of the response nouns in the learnin 
task is listed among Durrell’s words, As rd 
as was possible, pairs of response choices were 
matched with respect to Durrell’s readability 
values. Those nouns already selected for the 
task, which were not part of the Durrell list 
were checked against another Durrell list ‘ot 
vocabulary to be learned in the fourth de 
While not many of the learni pte 

S ning task nouns 
were found there, it was obvious that Durrell’ 
fourth grade list was at a higher icon f 
difficulty. It was concluded that th ek. 
selected would be well withi aglow: 

in the range of 


reading ability for th 
subjects, © proposed sample of 


The task was pre 
forms. In one form, s 
in a group situation, 
the accompanying En 


Pared in two diff 

p erent 
uitable for administration 
each German word and 


glish words A 
in large block letters on sheets ak ae 


inches. In another form th e 

typed on paper suitable tae tage WEW 
teaching machine (Koncept-o-graph F 4 a 

The acquisition trials were conti a 

each of 3 successive days: Monday pa a 
and Wednesday. On each of these dk uesday, 
of 20 words was presented with four sf i set 
each. The total of 80 Presentations eee wee 
required approximately 40 minutes to ay 
plete. The Criterion Measure was ROD aa: 
ministered until Friday. The test c Fa 


allı 
recognition of the English equivalent sir 
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four choices. The three distracters included 
the word used as an incorrect choice in the 
learning task and also two English words de- 
rived from other task items. 


Task Administration 


The task was presented with two major 


variations, an adaptation for learning in 4 , 


group, and one for learning in isolation. The 
first of these variations involved presentation 
of the task to a classroom group consisting of 
eight “pupil”-subjects seated in a familiar 
classroom row and facing the experimenter 
who functioned as the teacher. The “teacher”- 
experimenter stood approximately 7 feet from 
the center of the row, from which position 
she interacted with the odd numbered sub- 
jects in the row but not with those evenly 
numbered, except on a single practice trial 
which required participation by all subjects: 
Instructions were given concerning the gen- 
eral nature of the task and how one s^ the 
two English words which meant the same aS 
the German word was to be selected. In pe 
administration of the actual learning task +° 
teacher-experimenter held up a card an W 
was printed a German word. U ` n made ba 
statement such as the following: “John, this 


word is Baum.” The pupil-subject, John, 5€- 


lected one of two English words, alternatives 
as the equivalent of Baum, which appeare 
on the card held by the experimenter. If the 
subject said “TREE,” the correct choice, the 
experimenter responded, “right” or “that 15 
correct.” When he was wrong the experi- 
menter said nothing. The remainder of the 
group listened to the exchange. During the 
learning trials of that day John woulddhave 
been confronted with this same item a total ° 
four times. In all, he was presented with five 
such items, making a total of 20 presentations 
to which he respcaded on a single day. 
nature of the task was such that only n° 
subject at a time could be directly involve 
in responding and receiving feedback. 
meant that three of the four subjects Wh? 
vocally interacted with the experimenter were 
indirectly, or vicariously, involved with an 
item which went directly to the fourth. at 
experimenter who presented the learning ad 
to the group was a young woman WBO a 
several years of teaching experience. 
The task and the cøaditions unde 
was administered permitted the study of learn- 
ing under the following conditions: 
Condition A: Partial Verbal Intergction be- 


hich * 


r which it 


[2] 


tween Experimenter and Subject. The exper ° 


menter interacted with only the odd numbere 


~ 


Said 
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subjects, but, since these four subjects re- 
sponded in turn, interaction was on only one 
fourth of the vocabulary items. These same 
subjects, and odd numbered ones, also had the 
opportunity of learning the remaining items of 
the task (to which they did not respond di- 
rectly) by observing the interactions with the 
experimenter of the remaining odd numbered 
“subjects. Thus, they could learn one fourth of 
the ittms in the task through oral responding 
and reinforcement, while having the oppor- 
tunity to learn the remaining three fourths of 
the task through what is termed here vicarious 
learning. 

Condition B: No Verbal Interaction. Within 
the simulated classroom group a third learning 
condition existed. The even numbered sub- 
Jects had no interaction with the experimenter 
during the entire learning task. Whatever 
learning took place in them fell in the category 
of vicarious learning. 

The task was also arranged so that it could 
be presented to subjects who were to learn in 
isolation through a Koncept-o-graph teaching 
machine which utilized sheets of paper (8%x 
11 inches) on which the items were typed. 
Two different conditions of learning were in- 
troduced,,,; are labeled here C and D. 

Condition C: Isolation with Machine Feed- 
back. The subject ‘was seated in front of a 
teaching machine with only himself and the 
experimenter in the room. The machine pre- 
sented a German word together with the two 
English words. The subject made his choice, 
but neither wrote it down nor did he vocalize 
it. Following each item, the machine provided 
knowledge of results. 

Condition D: Isolation with Aural As Well 
sachin Feedback. This condition was 
identical with the previous one except that 
the subject was asked to say his response while 

© experimenter was seated beside him. If 
the response was corrects the experimenter 
Said, “right,” “that is correct,” or “correct.” 
the response was incorrect, the experimenter 
Nothing. In addition, the machine dis- 
Played the correct response. 


Sample 


Parti 


Scho Cipating subjects were 180 elementary 


Niue” children in the fourth, fifth, and sixth 
Wi 


Ta (91 boys and 89 girls). All subjects 


haq eie as to the purpose of the study and 
Buage°,2¢quaintance with the German lan- 
treat, è articipants were assigned to particular 
Meron, on the basis of a reading score 
Socia Politan, Iowa, or Science Research As- 


$ aS available in the school). A reading 


3 


TABLE 1 
DISTRIBUTION OF SUBJECTS py TREATMENT 


Treatment N 


Subjects in simulated classroom 
A. Subjects partially interacting with 
teacher-experimenter 


48 
B. Subjects not interacting with 
teacher-experimenter 48 
Subjects learning in isolation 
C. With feedback from the teaching 
machine only 44 
D. With feedback from both teaching 
machine and experimenter 40 


score was selected for equating groups be- 
cause: (a) performance on the task required 
some reading competence, and (b) reading 
ability and verbal learning measures have been 
demonstrated to be highly correlated (such 
tasks do not place high premium on intelli- 
gence—Wechsler, 1944). 

Table 1 presents the distribution of subjects 
according to learning conditions. Altogether 
12 simulated classroom groups of eight pupils 
in each were involved. Three elementary 
schools in Salt Lake City and one in a suburb 
provided subjects for the experiment. 


RESULTS 


The data consisted of scores derived 
from a multiple-choice test of German 
vocabulary administered to those who 
had been exposed to the various condi- 
tions. This test was administered on 
the Friday of the same week when the 
three learning sessions had taken place 
on Monday, Tuesday, and Wednesday. 
The test could be scored as a whole, or 
three separate scores could be derived 
measuring separately the learning ac- 
complished during each one of the learn- 
ing sessions. As a first step in the study 
of the data, an analysis of variance was 
undertaken involving the four conditions 
of learning, A, B, C, and D, as one set 
of comparisons and the three scores 
pertaining to the three learning sessions 
for another. The first 40 subjects in 
each treatment were used for this analy- 
sis. Table 2 summarizes the analysis of 
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TABLE 2 
ANALYSIS OF VARIANCE FOR LEARNING Conpitioxs ano Days OF THE LEARNING TRIALS 
- o Required 
5 .01 
Source df MS F -05 ia 
i z pa a 9 4.60 / 
Between days (lists) 2 777.0 82.7 i's w $65 
Between learning conditions 3 30.7 2 33 2.68 Be 
Interaction 6 33.0 3. 2.17 
Within 468 9.4 
Total 479 


variance. It is obvious that the amount 
of learning manifested at the time of 
the criterion test depends upon the 
particular day in the sequence when the 
learning originally occurred. It is also 
evident that the differences between 
learning conditions Surpassed the 5% 
level of significance. The interaction of 
learning condition and days is significant 
beyond the 1% level, Brief considera- 
tion must be given to each one of these 
significant differences, 


Differences between Days 


Retention scores on the Friday test 
showed a very marked decline from the 
first day through the second to the third 
day of learning. The task learned first 
was the one best remembered, and this 
applied to all learning conditions. 


. : 7 iLions 
Differences between Learning Conditio 


That significant differences exist ~ 
least at the 5% level of significance 3 
clear from the analysis of rea 
Table 3 provides information concern! pi 
the nature of this effect. Conditio?s 3 
and C indicate closely similar ey 
formances which are superior to ir 
ditions B and D which are very ne A 
to one another. Table 4 prods af 
Scheffe test which indicates the leve An 7 i 
significance for individual compariso oy 

Some results of additional interest K 
provided by a further breakdown at 
Condition A into the two omp den 
treatments which it involves. si d 
Condition A the experimenter interac tee 
with the learner during the presen aia: 
tion of 5 of the vocabulary itempi 
day of trials, and did not interact on t h 
other 15 items. On those items for whic 


3 


TABLE 3 
Mean Test PERFORMANCE oN Fray ror Eacu Day's Task ` 

Simulated 4 

classroom Isolated 4 

Simulated no teacher maces y 

classroom interaction Isolated feedback B r 

with teacher (vicarious machine teache: A R 

Task interaction learning) feedback only feedbac! j 

u 

Monday (20 items) 12.80 11.85 11.73 10.03 > 
Tuesday (20 items) 8.40 8.03 9.18 9.43 
Wednesday (20 items) 7.40 6.43 8.33 6.90 
Total for entire task 28.59 26.31 29.22 26.36 
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3 TABLE 4 


; Scuerre Test OF MULTIPLE COMPARISONS 
FOR LEARNING CONDITIONS TABLE 1 


| Required 
Source F 05 Ol 
I E a . z E 
i ~ da 
" A versus B 11.28 8.01 11.73 
Direct %4-+44 versus 
vicarious 4⁄4 
A versus D 10.74 8.01 11.73 
Direct %4+%4 versus 
isolated—aural feed- 
back 
a B versus C 18.19 8.01 11.73 
poe a 
Vicarious 44 "versus 
isolated 
C versus D 17.55 8.01 11.73 
Ay Isolated versus isolated— 
Fs aural feedback 
t 2a = 


there was direct interaction, the prob- 
` ability of a correct response on the Fri- 
day test was .54, while on the items 
PY vicariously experienced (no verbal inter- 
~œ action) the probability was .46. These 
two treatments within Condition A were 
significantly different in learning at the 
.002 level (¢ test with correlated data). 
D It is also of interest to note that the 
items on which the subjects interacted 
with the experimenter produced more 
learning than that produced by any of 
ñe learning conditions studied. This 
fact is made apparent in Figure 1 (top) 
where Condition A is shown in com- 
parison with Conditidh C. This graph 
suggests that there is least decline over 
the 3 days when the learning condition 
Tits the response-reinforcement learning 
paradigm, and most when learning is a 
relatively passive process. 
A A number of other comparisons within 


the data are worth noting. Under Con- 

‘ XN dition A three fourths of the items were 
. s Vicariously experienced (did not involve 
an interaction with the experimenter). 
$. ‘It is of considerable interest to compare 
the learning of these items within Con- 
dition A with the learning which occurs 
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Fic. 1. Criterion test performance (meas- 
ured Friday for each week of experimenting), 
showing separate retention of learning for 
Monday’s, Tuesday’s and Wednesday’s tasks. 


in Condition B and which involved only 
vicarious learning. This comparison is 
shown in Figure 1 (bottom) which pre- 
sents the amount of vicarious learning 
in terms of the probability of answering 
the items correctly in the test on Friday. 
Apparently, the advantage of Condi- 
tion A is restricted to those items on 
which there was a verbal exchange be- 
tween the experimenter and the subject, 
since the two vicarious conditions ap- 
pear not to differ with respect to learn- 
ing. 


Interaction between Learning Conditions 
and Days 


This interaction is best understood by 
reference to the means presented in 
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Table 3. The means by days show that 
there is a more rapid decline in perform- 
ance in the simulated classroom situa- 
tion (Conditions A and B) than in the 
teaching machine situation (Conditions 
C and D). A final point to note from 
Table 3 is that the vicarious learning 
situation appears to show a greater de- 
cline over the 3 days than does any other 
learning condition. The data are not 
sufficient to make any great issue of this 
point, but they indicate a line for further 
research, 


DISCUSSION 


The data reported here make it pos- 
sible to compare the effectiveness of 
learning under various conditions includ- 
ing those commonly observed in class- 
rooms and also under conditions which 
approximate closely those of the rein- 
forcement paradigm. While the advo- 
cates of the application of the reinforce- 
ment paradigm to the planning of school 
learning have claimed that such applica- 
tion would produce dramatic increases 
in the learning of Pupils, the results of 
the study do not Support this position, 
Those subjects who interacted with the 
experimenter and whose learning be- 
havior followed the familiar reinforce- 
ment paradigm obtained a score of 54% 
on Friday on those items on which they 
had direct interaction, while the 
vicarious subjects who never interacted 
with the experimenter during the ad- 
ministration of the task achieved a score 
of 44.3%. The two conditions Probably 
represent the best and worst conditions 
of learning commonly observed in 
schools. However, the fact that Condi- 
tion B, learning entirely by vicarious 
experience, showed such a marked de- 
cline in performance Suggests that for 
this group the situation becomes dull 
and progressively less capable of com- 
manding task orientation. While the 
decline in performance in all groups 


from Monday through Tuesday to 
Wednesday is marked, and may well be 
due partly to a proactive inhibition ef- 
fect, the particularly striking decline of 
the vicarious group suggests that an at- 
tention factor is involved and may be 
partially responsible for the effect. It 
would be of some interest to prelong 
such a learning series over a much longer 
period than 3 days to determine whether 
the deterioration of the vicarious learn- 
ing group would become progressively 
more marked. One suspects that it 
would. 2 
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